00000100:00100000:0.0F:1787096587.276046:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0F:1787096587.276214:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345507328 00000100:00100000:2.0:1787096587.276232:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345507328 00000100:00080000:1.0F:1787096587.276287:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1787096587.276326:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 193 00000100:00100000:2.0:1787096587.276339:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+17:35372:x1873906345507328:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:2.0:1787096587.276375:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096587.276407:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b600/0xa979d75fc166c07a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b20a3 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.276744:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4aa00/0xa979d75fc166c081 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.276762:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4aa00/0xa979d75fc166c081 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.276777:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4aa00/0xa979d75fc166c081 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096587.276893:0:9989:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1787096587.276898:0:9989:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787096587.276918:0:9989:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4aa00/0xa979d75fc166c081 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.276946:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b600/0xa979d75fc166c07a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20a3 expref: 19 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.276967:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4aa00/0xa979d75fc166c081 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20a3 expref: 18 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.276977:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff961742a1e300) 00010000:00010000:2.0:1787096587.276981:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787096587.276984:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4aa00, rc 0) 00000100:00100000:2.0:1787096587.277068:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+18:35372:x1873906345507328:12345-192.168.201.40@tcp:101:rm.0 Request processed in 732us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096587.277075:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 193 00000100:00100000:0.0:1787096587.278901:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096587.278953:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345507456 00000100:00100000:2.0:1787096587.278963:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345507456 00000100:00100000:2.0:1787096587.279025:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 194 00000100:00100000:2.0:1787096587.279036:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+18:35372:x1873906345507456:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:2.0:1787096587.279055:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096587.279072:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c088 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b20aa expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.279125:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a800/0xa979d75fc166c08f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.279139:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a800/0xa979d75fc166c08f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.279165:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a800/0xa979d75fc166c08f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096587.279213:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000400:0x6:0x0]: returning size 4096 00000004:00200000:2.0:1787096587.279219:0:6488:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787096587.279320:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c088 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20aa expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.279341:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a800/0xa979d75fc166c08f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20aa expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.279350:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff961742a1e200) 00010000:00010000:2.0:1787096587.279360:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787096587.279365:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4a800, rc 0) 00000100:00100000:2.0:1787096587.279423:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+19:35372:x1873906345507456:12345-192.168.201.40@tcp:101:rm.0 Request processed in 388us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096587.279432:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 194 00000100:00100000:1.0:1787096587.283472:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096587.283520:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345507712 00000100:00100000:2.0:1787096587.283532:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345507712 00000100:00100000:2.0:1787096587.283600:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 195 00000100:00100000:2.0:1787096587.283651:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961877976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+19:35372:x1873906345507712:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:2.0:1787096587.283678:0:8109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096587.283703:0:8109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b600/0xa979d75fc166c096 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b20b1 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096587.283883:0:8109:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 4096 00010000:00010000:2.0:1787096587.284183:0:8109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b600/0xa979d75fc166c096 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20b1 expref: 21 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.284199:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff961742a26800) 00010000:00010000:2.0:1787096587.284201:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787096587.284206:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b600/0xa979d75fc166c096 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20b1 expref: 21 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.284226:0:8109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4b600, rc 0) 00000100:00100000:2.0:1787096587.284300:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961877976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+20:35372:x1873906345507712:12345-192.168.201.40@tcp:101:rm.0 Request processed in 655us (860us total) trans 4294967320 rc 301/301 00000100:00100000:2.0:1787096587.284307:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 195 00000100:00100000:2.0:1787096587.287134:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096587.287198:0:13534:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345507840 00000100:00100000:0.0:1787096587.287210:0:13534:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345507840 00000100:00100000:0.0:1787096587.287281:0:13534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 32 00000100:00100000:0.0:1787096587.287295:0:13534:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96185818f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:70e19547-606a-4706-b016-3476e377d7df+20:35372:x1873906345507840:12345-192.168.201.40@tcp:37:rm.0 00000100:00100000:1.0:1787096587.289924:0:13534:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96185818f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:70e19547-606a-4706-b016-3476e377d7df+20:35372:x1873906345507840:12345-192.168.201.40@tcp:37:rm.0 Request processed in 2621us (2790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096587.289941:0:13534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 32 00000100:00100000:1.0:1787096587.293929:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096587.293989:0:6492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345507968 00000100:00100000:2.0:1787096587.294009:0:6492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345507968 00000100:00100000:2.0:1787096587.294089:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 33 00000100:00100000:2.0:1787096587.294101:0:6492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961877976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+8:35372:x1873906345507968:12345-192.168.201.40@tcp:37:rm.0 00000100:00080000:1.0:1787096587.294483:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0F:1787096587.298870:0:6492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961877976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+8:35372:x1873906345507968:12345-192.168.201.40@tcp:37:rm.0 Request processed in 4756us (4939us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096587.298892:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 33 00000100:00100000:3.0:1787096587.301392:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096587.301554:0:13534:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345508224 00000100:00100000:1.0:1787096587.301569:0:13534:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345508224 00000100:00100000:1.0:1787096587.301638:0:13534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 34 00000100:00100000:1.0:1787096587.301652:0:13534:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:70e19547-606a-4706-b016-3476e377d7df+20:35372:x1873906345508224:12345-192.168.201.40@tcp:35:rm.0 00000100:00100000:1.0:1787096587.301964:0:13534:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:70e19547-606a-4706-b016-3476e377d7df+21:35372:x1873906345508224:12345-192.168.201.40@tcp:35:rm.0 Request processed in 312us (581us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1787096587.301974:0:13534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 34 00000100:00100000:1.0:1787096587.304836:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096587.304942:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345508480 00000100:00100000:0.0:1787096587.304954:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345508480 00000100:00100000:0.0:1787096587.305098:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 196 00000100:00100000:0.0:1787096587.305111:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+21:35372:x1873906345508480:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:0.0:1787096587.305139:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096587.305168:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e400/0xa979d75fc166c0a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b20b8 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.305348:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fe00/0xa979d75fc166c0ab lrc: 3/1,0 mode: --/CR res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.305367:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fe00/0xa979d75fc166c0ab lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.305380:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fe00/0xa979d75fc166c0ab lrc: 3/1,0 mode: CR/CR res: [0x240000402:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096587.305394:0:9989:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 4096 00010000:00010000:0.0:1787096587.305529:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e400/0xa979d75fc166c0a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20b8 expref: 24 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.305552:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fe00/0xa979d75fc166c0ab lrc: 3/0,0 mode: CR/CR res: [0x240000402:0x5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20b8 expref: 23 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.305574:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff961742a1e300) 00010000:00010000:0.0:1787096587.305578:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787096587.305583:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340fe00, rc 0) 00000100:00100000:0.0:1787096587.305721:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+23:35372:x1873906345508480:12345-192.168.201.40@tcp:101:rm.0 Request processed in 612us (896us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787096587.305728:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 196 00000100:00100000:2.0:1787096587.309798:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096587.309853:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345508608 00000100:00100000:0.0:1787096587.309866:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345508608 00000100:00100000:0.0:1787096587.309941:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 197 00000100:00100000:0.0:1787096587.309968:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+8:35372:x1873906345508608:12345-192.168.201.40@tcp:41:rm.0 00000004:00000024:0.0:1787096587.310051:0:6488:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1787096587.310128:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742c65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+8:35372:x1873906345508608:12345-192.168.201.40@tcp:41:rm.0 Request processed in 177us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096587.310136:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 197 00000100:00100000:0.0:1787096587.313938:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096587.313998:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345508736 00000100:00100000:2.0:1787096587.314012:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345508736 00000100:00100000:2.0:1787096587.314087:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 198 00000100:00100000:2.0:1787096587.314101:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+23:35372:x1873906345508736:12345-192.168.201.40@tcp:101:rm.0 00010000:00010000:2.0:1787096587.314133:0:8109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096587.314161:0:8109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b600/0xa979d75fc166c0b9 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b20bf expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314250:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c0c0 lrc: 3/1,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314269:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c0c0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314283:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c0c0 lrc: 3/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314298:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ae00/0xa979d75fc166c0c7 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314306:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ae00/0xa979d75fc166c0c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314313:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ae00/0xa979d75fc166c0c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314408:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4be00/0xa979d75fc166c0ce lrc: 3/1,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314424:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4be00/0xa979d75fc166c0ce lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314431:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4be00/0xa979d75fc166c0ce lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096587.314513:0:8109:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x6:0x0]: returning size 0 00000004:00200000:2.0:1787096587.314518:0:8109:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787096587.314540:0:8109:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4be00/0xa979d75fc166c0ce lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314552:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4be00/0xa979d75fc166c0ce lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314563:0:8109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c0c0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314571:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c0c0 lrc: 4/1,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314578:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c0c0 lrc: 3/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314584:0:8109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c0c0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314591:0:8109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4b800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096587.314596:0:8109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c0c0 lrc: 4/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314603:0:8109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c0c0 lrc: 5/0,0 mode: CR/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314628:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff961742a1e200) 00010000:00010000:2.0:1787096587.314632:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096587.314935:0:8109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c0c0 lrc: 3/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314944:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c0c0 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314971:0:8109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ae00/0xa979d75fc166c0c7 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314979:0:8109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ae00/0xa979d75fc166c0c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314985:0:8109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ae00/0xa979d75fc166c0c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.314991:0:8109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4ae00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096587.314995:0:8109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ae00/0xa979d75fc166c0c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.315002:0:8109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ae00/0xa979d75fc166c0c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.315013:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0xdd5a5043 (ffff961742a1e700) 00010000:00010000:2.0:1787096587.315015:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096587.315019:0:8109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ae00/0xa979d75fc166c0c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.315025:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4ae00/0xa979d75fc166c0c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.315072:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b600/0xa979d75fc166c0b9 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20bf expref: 25 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.315088:0:8109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4be00/0xa979d75fc166c0ce lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20bf expref: 24 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.315097:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff961742a26800) 00010000:00010000:2.0:1787096587.315100:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787096587.315103:0:8109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4be00, rc 0) 00000100:00100000:2.0:1787096587.315187:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+24:35372:x1873906345508736:12345-192.168.201.40@tcp:101:rm.0 Request processed in 1089us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096587.315196:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 198 00000100:00100000:1.0:1787096587.317598:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096587.317676:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345508992 00000100:00100000:0.0:1787096587.317688:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345508992 00000100:00100000:0.0:1787096587.317756:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 199 00000100:00100000:0.0:1787096587.317770:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+24:35372:x1873906345508992:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:0.0:1787096587.317852:0:9989:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787096587.317894:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4be00/0xa979d75fc166c0ce lrc: 0/0,0 mode: --/PR res: [0x240000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20bf expref: 24 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.317916:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff961742a26800) 00010000:00010000:0.0:1787096587.317936:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4a800/0xa979d75fc166c08f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20aa expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.317956:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff961742a1e200) 00010000:00010000:0.0:1787096587.317960:0:9989:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096587.317984:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c0d5 lrc: 3/0,1 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318000:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c0d5 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318011:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c0d5 lrc: 3/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318022:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166c0dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318030:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166c0dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318037:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166c0dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318144:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166c0e3 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318153:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166c0e3 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318161:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166c0e3 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318420:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c0ea lrc: 3/0,1 mode: --/PW res: [0x240000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318476:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c0ea lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318485:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c0ea lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318495:0:9989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c0ea lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318502:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c0ea lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318509:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c0ea lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318535:0:9989:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787096587.318552:0:7858:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096587.318555:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166c0e3 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318562:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166c0e3 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318570:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166c0e3 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.318571:0:7858:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c0ea lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.318589:0:7858:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340f400 already unused, calling callback (ffffffffc0bda6f0) 00010000:00010000:0.0:1787096587.318589:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340ee00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096587.318596:0:7858:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c0ea lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318597:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166c0e3 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318606:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166c0e3 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.318619:0:7858:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c0ea lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318647:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff961741933100) 00010000:00010000:0.0:1787096587.318651:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787096587.318655:0:7858:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x6:0x0].0x0 (ffff961741933100) 00010000:00010000:0.0:1787096587.318657:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166c0e3 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.318661:0:7858:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787096587.318666:0:7858:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c0ea lrc: 1/0,0 mode: --/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318669:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340ee00/0xa979d75fc166c0e3 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.318683:0:7858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c0ea lrc: 0/0,0 mode: --/PW res: [0x240000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318691:0:9989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c0d5 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318698:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c0d5 lrc: 4/0,1 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.318702:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096587.318705:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096587.318705:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c0d5 lrc: 3/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.318709:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096587.318715:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c0d5 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318721:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340e000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:0.0:1787096587.318724:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c0d5 lrc: 4/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318730:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c0d5 lrc: 5/0,0 mode: CW/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318739:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff961742a1e200) 00010000:00010000:0.0:1787096587.318741:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096587.318745:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c0d5 lrc: 3/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318762:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e000/0xa979d75fc166c0d5 lrc: 0/0,0 mode: --/CW res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096587.318773:0:9989:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000279b0cb6 reply state 000000007b84c5ca transno 4294967323 ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166c0dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318797:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166c0dc lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.318804:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0xdd5a5043 (ffff961742a1e700) 00010000:00010000:0.0:1787096587.318806:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096587.318810:0:9989:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787096587.318900:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+24:35372:x1873906345508992:12345-192.168.201.40@tcp:36:rm.0 Request processed in 1132us (1307us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1787096587.318910:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 199 00000100:00100000:0.0:1787096587.320876:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096587.320917:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096587.320934:0:6492:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345509376 00000100:00100000:2.0:1787096587.320945:0:6492:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345509376 00000100:00100000:2.0:1787096587.321012:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 35 00000100:00100000:2.0:1787096587.321025:0:6492:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+24:35372:x1873906345509376:12345-192.168.201.40@tcp:35:rm.0 00000100:00100000:2.0:1787096587.321280:0:6492:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:70e19547-606a-4706-b016-3476e377d7df+25:35372:x1873906345509376:12345-192.168.201.40@tcp:35:rm.0 Request processed in 256us (408us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787096587.321291:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 35 00000100:00100000:0.0:1787096587.322531:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096587.322565:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345509632 00000100:00100000:2.0:1787096587.322572:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345509632 00000100:00100000:2.0:1787096587.322629:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 200 00000100:00100000:2.0:1787096587.322640:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+25:35372:x1873906345509632:12345-192.168.201.40@tcp:36:rm.0 00010000:00010000:2.0:1787096587.322683:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787096587.322708:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fe00/0xa979d75fc166c0ab lrc: 0/0,0 mode: --/CR res: [0x240000402:0x5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20b8 expref: 25 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.322732:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4aa00/0xa979d75fc166c081 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20a3 expref: 24 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.322743:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf5800/0xa979d75fc166c011 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2079 expref: 23 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.322751:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff961742a1e300) 00010000:00010000:2.0:1787096587.322755:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096587.322863:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.322872:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.322883:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096587.322910:0:6488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742ccb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353979008:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1787096587.322960:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096587.323001:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353979008 00000100:00100000:0.0:1787096587.323006:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353979008 00000100:00100000:2.0:1787096587.323015:0:6488:0:(client.c:2692:ptlrpc_set_wait()) set ffff961850218c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787096587.323070:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787096587.323079:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:6488:x1873906353979008:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787096587.323090:0:7418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096587.323103:0:7418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166c0f8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166c0f1 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.323133:0:7418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166bfe7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b206b expref: 7 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.323152:0:7418:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166c0f8 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166c0f1 expref: 8 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.323179:0:7418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166bfe7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b206b expref: 7 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.323190:0:7418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166bfe7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b206b expref: 7 pid: 6489 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096587.323198:0:7418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e6d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7418:1873906353979136:192.168.201.40@tcp:104: 00000100:00100000:2.0:1787096587.323249:0:7418:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741f14000 going to sleep for 11 seconds 00000100:00100000:1.0:1787096587.323674:0:8380:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345509120 00000100:00100000:1.0:1787096587.323679:0:8380:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345509120 00000100:00100000:1.0:1787096587.323717:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 15 00000100:00100000:1.0:1787096587.323725:0:8380:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:70e19547-606a-4706-b016-3476e377d7df+8:2400:x1873906345509120:12345-192.168.201.40@tcp:103:rm.0 00010000:00010000:1.0:1787096587.323734:0:8380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096587.323746:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e600/0xa979d75fc166c003 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2072 expref: 8 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.323757:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff961741933300) 00010000:00010000:1.0:1787096587.323765:0:8380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787096587.323806:0:8380:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:70e19547-606a-4706-b016-3476e377d7df+7:2400:x1873906345509120:12345-192.168.201.40@tcp:103:rm.0 Request processed in 83us (2889us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096587.323811:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 15 00000100:00100000:2.0:1787096587.324286:0:7418:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e6d80 pname:cluuid:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000_UUID:7418:1873906353979136:192.168.201.40@tcp:104: 00010000:00010000:2.0:1787096587.324312:0:7418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166c0f8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166c0f1 expref: 8 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.324322:0:7418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:2.0:1787096587.324324:0:7418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096587.324328:0:7418:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166c0f8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166c0f1 expref: 8 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.324335:0:7418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4ac00, rc 0) 00000100:00100000:2.0:1787096587.324603:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+8:6488:x1873906353979008:12345-0@lo:101:mdt00_000.0 Request processed in 1525us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096587.324610:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787096587.324751:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096587.324817:0:7412:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345509760 00000100:00100000:1.0:1787096587.324824:0:7412:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345509760 00010000:00010000:1.0:1787096587.324846:0:7412:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166bfe7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b206b expref: 7 pid: 6489 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096587.324891:0:7412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 71 00000100:00100000:1.0:1787096587.324900:0:7412:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70e19547-606a-4706-b016-3476e377d7df+7:2401:x1873906345509760:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096587.324911:0:7412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096587.324929:0:7412:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166bfe7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b206b expref: 7 pid: 6489 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.324942:0:7412:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166bfe7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b206b expref: 7 pid: 6489 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.324958:0:7412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166bfe7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b206b expref: 7 pid: 6489 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.324969:0:7412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:1.0:1787096587.324974:0:7412:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166c0f8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166c0f1 expref: 7 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.325001:0:7412:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166c0f8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xa979d75fc166c0f1 expref: 7 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096587.325002:0:6488:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742ccb800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353979008:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787096587.325012:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166c0f8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0xa979d75fc166c0f1 expref: 7 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.325020:0:6488:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.325028:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.325040:0:7412:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166c0f8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166c0f1 expref: 7 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096587.325054:0:7412:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f69880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:7412:1873906353979264:0@lo:105: 00000100:00100000:1.0:1787096587.325088:0:7412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096587.325119:0:7412:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787096587.325153:0:6471:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353979264 00000100:00100000:0.0:1787096587.325165:0:6471:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353979264 00000100:00100000:0.0:1787096587.325206:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787096587.325214:0:6471:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7412:x1873906353979264:12345-0@lo:105: 00010000:00010000:0.0:1787096587.325226:0:6471:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.325246:0:6471:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.325256:0:6471:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.325265:0:6471:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.325273:0:6471:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.325282:0:6471:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.325312:0:6471:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff961845b4a600) 00000100:00100000:0.0:1787096587.325357:0:6471:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:7412:x1873906353979264:12345-0@lo:105: Request processed in 144us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096587.325363:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787096587.325395:0:7412:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f69880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000_UUID:7412:1873906353979264:0@lo:105: 00010000:00010000:1.0:1787096587.325406:0:7412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787096587.325463:0:7412:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:70e19547-606a-4706-b016-3476e377d7df+6:2401:x1873906345509760:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 539us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096587.325477:0:7412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 71 00010000:00010000:2.0:1787096587.325973:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.325985:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787096587.326012:0:6488:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787096587.326052:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166c0ff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.326061:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166c0ff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.326071:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166c0ff lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096587.326089:0:6488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353979392:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1787096587.326128:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096587.326157:0:6488:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741f14000 going to sleep for 11 seconds 00000100:00100000:1.0:1787096587.326179:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353979392 00000100:00100000:1.0:1787096587.326184:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353979392 00000100:00100000:1.0:1787096587.326223:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1787096587.326233:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:6488:x1873906353979392:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787096587.326249:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096587.326264:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5000/0xa979d75fc166c106 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166c0ff expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.326285:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5000/0xa979d75fc166c106 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166c0ff expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.326297:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5000/0xa979d75fc166c106 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166c0ff expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.326306:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb790e34b (ffff961742a1eb00) 00010000:00010000:1.0:1787096587.326309:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096587.326312:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf5000, rc 0) 00000100:00100000:1.0:1787096587.326353:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6488:x1873906353979392:12345-0@lo:101:mdt00_000.0 Request processed in 123us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096587.326359:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787096587.326400:0:6488:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353979392:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787096587.326418:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166c0ff lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166c106 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.326429:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166c0ff lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166c106 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787096587.326482:0:6488:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1787096587.326521:0:6488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353979520:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787096587.326563:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096587.326602:0:6488:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741f14900 going to sleep for 11 seconds 00000100:00100000:1.0:1787096587.326631:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353979520 00000100:00100000:1.0:1787096587.326636:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353979520 00000100:00100000:1.0:1787096587.326669:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787096587.326677:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6488:x1873906353979520:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787096587.326747:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742e5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6488:x1873906353979520:12345-0@lo:1000:mdt00_000.0 Request processed in 71us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096587.326761:0:6488:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353979520:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787096587.326765:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787096587.326816:0:6488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c9e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353979648:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787096587.326840:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096587.326861:0:6488:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741f14900 going to sleep for 11 seconds 00000100:00100000:1.0:1787096587.326875:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353979648 00000100:00100000:1.0:1787096587.326880:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353979648 00000100:00100000:1.0:1787096587.326907:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787096587.326913:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c8d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6488:x1873906353979648:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787096587.326998:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c8d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:6488:x1873906353979648:12345-0@lo:1000:mdt00_000.0 Request processed in 84us (156us total) trans 0 rc 1/1 00000100:00100000:2.0:1787096587.327015:0:6488:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c9e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353979648:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787096587.327058:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4ae00/0xa979d75fc166c10d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096587.327066:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00010000:00010000:2.0:1787096587.327072:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4ae00/0xa979d75fc166c10d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.327081:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4ae00/0xa979d75fc166c10d lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096587.327103:0:6488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c8d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353979776:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1787096587.327126:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096587.327145:0:6488:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741f14000 going to sleep for 11 seconds 00000100:00100000:1.0:1787096587.327959:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353979776 00000100:00100000:1.0:1787096587.327966:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353979776 00000100:00100000:1.0:1787096587.328016:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787096587.328025:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+9:6488:x1873906353979776:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787096587.328037:0:7418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096587.328054:0:7418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c114 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166c10d expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.328076:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c114 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166c10d expref: 10 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.328089:0:7418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c114 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166c10d expref: 10 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.328098:0:7418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff961742a1ef00) 00010000:00010000:1.0:1787096587.328101:0:7418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787096587.328104:0:7418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf5c00, rc 0) 00000100:00100000:1.0:1787096587.328154:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c9e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+10:6488:x1873906353979776:12345-0@lo:101:mdt00_000.0 Request processed in 130us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096587.328171:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787096587.328292:0:6488:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c8d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353979776:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787096587.328306:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4ae00/0xa979d75fc166c10d lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166c114 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.328317:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4ae00/0xa979d75fc166c10d lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166c114 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.328343:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c11b lrc: 3/0,1 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.328354:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c11b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.328369:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c11b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.328390:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b200/0xa979d75fc166c122 lrc: 3/0,1 mode: --/EX res: [0x240000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.328398:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b200/0xa979d75fc166c122 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.328405:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b200/0xa979d75fc166c122 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.328433:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.328472:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.328482:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096587.328498:0:6488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c8d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353979904:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1787096587.328535:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096587.328556:0:6488:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741f14000 going to sleep for 11 seconds 00000100:00100000:1.0:1787096587.328570:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353979904 00000100:00100000:1.0:1787096587.328576:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353979904 00000100:00100000:1.0:1787096587.328616:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787096587.328624:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961875503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:6488:x1873906353979904:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787096587.328634:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096587.328644:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4200/0xa979d75fc166c130 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166c129 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.328665:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c02d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2087 expref: 5 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.328676:0:6494:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4200/0xa979d75fc166c130 lrc: 4/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166c129 expref: 11 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.328701:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c02d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2087 expref: 5 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.328715:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c02d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2087 expref: 5 pid: 8109 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096587.328728:0:6494:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f69880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6494:1873906353980032:192.168.201.40@tcp:104: 00000100:00100000:1.0:1787096587.328821:0:6494:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187cad6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096587.335015:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096587.335051:0:6473:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345509888 00000100:00100000:2.0:1787096587.335062:0:6473:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345509888 00010000:00010000:2.0:1787096587.335109:0:6473:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c02d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2087 expref: 6 pid: 8109 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096587.335159:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 72 00000100:00100000:2.0:1787096587.335183:0:6473:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187574b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70e19547-606a-4706-b016-3476e377d7df+6:2400:x1873906345509888:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787096587.335200:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096587.335208:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c02d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2087 expref: 6 pid: 8109 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.335221:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c02d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2087 expref: 6 pid: 8109 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.335243:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96184a9ea200) 00010000:00010000:2.0:1787096587.335248:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4200/0xa979d75fc166c130 lrc: 3/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166c129 expref: 11 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.335275:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4200/0xa979d75fc166c130 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xa979d75fc166c129 expref: 11 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.335287:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4200/0xa979d75fc166c130 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0xa979d75fc166c129 expref: 11 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.335330:0:6473:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4200/0xa979d75fc166c130 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166c129 expref: 11 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096587.335345:0:6473:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6473:1873906353980160:0@lo:105: 00000100:00100000:2.0:1787096587.335399:0:6473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096587.335436:0:8379:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353980160 00000100:00100000:0.0:1787096587.335459:0:8379:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353980160 00000100:00100000:2.0:1787096587.335463:0:6473:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741f14900 going to sleep for 11 seconds 00000100:00100000:0.0:1787096587.335492:0:8379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787096587.335501:0:8379:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6473:x1873906353980160:12345-0@lo:105: 00010000:00010000:2.0:1787096587.335505:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4600/0xa979d75fc166c02d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b2087 expref: 6 pid: 8109 timeout: 369 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.335519:0:8379:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166c130 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096587.335522:0:6494:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f69880 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000_UUID:6494:1873906353980032:192.168.201.40@tcp:104: 00010000:00010000:0.0:1787096587.335530:0:8379:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166c130 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.335539:0:8379:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166c130 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.335546:0:8379:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa979d75fc166c130 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.335552:0:8379:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0xa979d75fc166c130 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.335554:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4200/0xa979d75fc166c130 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166c129 expref: 11 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.335562:0:8379:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 5/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0xa979d75fc166c130 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096587.335563:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96184a9ea200) 00010000:00010000:2.0:1787096587.335566:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096587.335569:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf4200, rc 0) 00010000:00010000:0.0:1787096587.335576:0:8379:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff961845b4b400) 00000100:00100000:0.0:1787096587.335612:0:8379:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6473:x1873906353980160:12345-0@lo:105: Request processed in 113us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096587.335620:0:8379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787096587.335945:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961875503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:6488:x1873906353979904:12345-0@lo:101:mdt00_000.0 Request processed in 7321us (7410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096587.335954:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787096587.335993:0:6473:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6473:1873906353980160:0@lo:105: 00010000:00010000:2.0:1787096587.336006:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787096587.336051:0:6473:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187574b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70e19547-606a-4706-b016-3476e377d7df+5:2400:x1873906345509888:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 876us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096587.336059:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 72 00000100:00100000:2.0:1787096587.336173:0:6488:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c8d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353979904:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787096587.336187:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166c130 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096587.336865:0:6488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353980288:0@lo:403:mdt00_000.0 00000100:00100000:2.0:1787096587.336900:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096587.336919:0:6488:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741f14000 going to sleep for 11 seconds 00000100:00100000:1.0:1787096587.336936:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353980288 00000100:00100000:1.0:1787096587.336943:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353980288 00000100:00100000:1.0:1787096587.336982:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787096587.336992:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6488:x1873906353980288:12345-0@lo:403:mdt00_000.0 00000100:00100000:1.0:1787096587.339423:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:6488:x1873906353980288:12345-0@lo:403:mdt00_000.0 Request processed in 2425us (2514us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096587.339474:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787096587.339509:0:6488:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:6488:1873906353980288:0@lo:403:mdt00_000.0 00000040:00080000:3.0:1787096587.340765:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].6, 936 off42032 00000040:00080000:3.0:1787096587.340974:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].6, 1016 off42872 00000004:00080000:3.0:1787096587.340982:0:6488:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff961742a35e40 with version 9 00000004:00080000:0.0:1787096587.341029:0:7416:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96184550da80 version 9 rpc_version 9 00000020:00100000:0.0:1787096587.341066:0:7416:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096587.341077:0:7416:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff961742fd1880 x1873906353980544/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2592/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096587.341102:0:7416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742fd1880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353980544:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096587.341170:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096587.341207:0:7416:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618757cb600 going to sleep for 11 seconds 00000100:00100000:1.0:1787096587.341245:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353980544 00000100:00100000:1.0:1787096587.341256:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353980544 00000100:00100000:1.0:1787096587.341323:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787096587.341334:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:7416:x1873906353980544:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1787096587.341834:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+12:7416:x1873906353980544:12345-0@lo:1000:osp_up0-1.0 Request processed in 502us (663us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787096587.341844:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787096587.341911:0:7416:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742fd1880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353980544:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096587.342583:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787096587.342598:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96186dfbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353980672:0@lo:13:osp-pre-0-0.0 00000004:00200000:1.0:1787096587.342629:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x5:0x0]: returning size 4096 00010000:00010000:1.0:1787096587.342647:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b200/0xa979d75fc166c122 lrc: 3/0,1 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096587.342648:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787096587.342660:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b200/0xa979d75fc166c122 lrc: 2/0,0 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.342666:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b200/0xa979d75fc166c122 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.342671:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4b200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096587.342675:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b200/0xa979d75fc166c122 lrc: 3/0,0 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.342681:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b200/0xa979d75fc166c122 lrc: 4/0,0 mode: EX/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.342699:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff961742a1e200) 00010000:00010000:1.0:1787096587.342701:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:3.0:1787096587.342708:0:3637:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353980800:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1787096587.342718:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b200/0xa979d75fc166c122 lrc: 2/0,0 mode: --/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.342724:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b200/0xa979d75fc166c122 lrc: 0/0,0 mode: --/EX res: [0x240000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.342738:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166c130 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096587.342750:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787096587.342751:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166c130 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.342759:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166c130 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.342777:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1787096587.342797:0:6488:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x6:0x0] 00010000:00010000:1.0:1787096587.342810:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c11b lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096587.342815:0:8366:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353980672 00010000:00010000:1.0:1787096587.342816:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c11b lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096587.342825:0:8366:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353980672 00010000:00010000:1.0:1787096587.342827:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c11b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.342833:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4b800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096587.342836:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c11b lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.342842:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c11b lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.342869:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff961742a1e300) 00010000:00010000:1.0:1787096587.342873:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096587.342877:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c11b lrc: 2/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096587.342882:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353980928:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1787096587.342884:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4b800/0xa979d75fc166c11b lrc: 0/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096587.342894:0:8366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00010000:00010000:1.0:1787096587.342897:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4ae00/0xa979d75fc166c10d lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166c114 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096587.342907:0:8366:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186dfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353980672:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787096587.342909:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4ae00/0xa979d75fc166c10d lrc: 4/0,1 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166c114 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.342923:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4ae00/0xa979d75fc166c10d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166c114 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096587.342931:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787096587.342942:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00000024:3.0:1787096587.342947:0:8366:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000004:00080000:1.0:1787096587.342953:0:6488:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1787096587.342959:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.342967:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.342973:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.342989:0:6488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:0.0:1787096587.342989:0:8367:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353980928 00000100:00100000:0.0:1787096587.342995:0:8367:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353980928 00000004:00080000:1.0:1787096587.343001:0:6488:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1787096587.343009:0:8366:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186dfb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353980672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (358us total) trans 0 rc 0/0 00010000:00010000:1.0:1787096587.343009:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166c0ff lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166c106 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096587.343031:0:8366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:1.0:1787096587.343032:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166c0ff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166c106 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096587.343042:0:8367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787096587.343054:0:8367:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906353980928:12345-0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787096587.343070:0:10297:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00002000:00000024:0.0:1787096587.343073:0:8367:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00010000:3.0:1787096587.343079:0:10297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xa979d75fc166c130 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096587.343093:0:10297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4b400 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:3.0:1787096587.343106:0:10297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa979d75fc166c130 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096587.343111:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+23:35372:x1873906345509632:12345-192.168.201.40@tcp:36:rm.0 Request processed in 20468us (20578us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1787096587.343122:0:8367:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3634:x1873906353980928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096587.343139:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 200 00000100:00100000:0.0:1787096587.343139:0:8367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000004:00010000:3.0:1787096587.343140:0:10297:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa979d75fc166c130 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096587.343180:0:10297:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166c130 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1787096587.343188:0:3634:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96187c813480 x1873906353980928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1787096587.343198:0:10297:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096587.343212:0:10297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 1/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166c130 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096587.343218:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c813480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353980928:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1787096587.343232:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b400/0xa979d75fc166c129 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166c130 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096587.343249:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1787096587.343258:0:10297:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1787096587.343262:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9617429a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353981056:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096587.343266:0:10297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4ae00/0xa979d75fc166c10d lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xa979d75fc166c114 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096587.343277:0:10297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4ae00 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:3.0:1787096587.343282:0:10297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4ae00/0xa979d75fc166c10d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa979d75fc166c114 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096587.343289:0:10297:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4ae00/0xa979d75fc166c10d lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa979d75fc166c114 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096587.343306:0:10297:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4ae00/0xa979d75fc166c10d lrc: 2/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166c114 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096587.343322:0:10297:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096587.343343:0:10297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4ae00/0xa979d75fc166c10d lrc: 1/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166c114 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096587.343350:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4ae00/0xa979d75fc166c10d lrc: 0/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166c114 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096587.343365:0:10297:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096587.343368:0:10297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096587.343375:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9617429a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353981184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096587.343377:0:10297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4a600 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:3.0:1787096587.343385:0:10297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096587.343394:0:10297:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096587.343414:0:10297:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096587.343421:0:10297:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096587.343429:0:10297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096587.343429:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787096587.343470:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4a600/0xa979d75fc166c0f1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166c0f8 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096587.343501:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096587.343502:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1787096587.343510:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096587.343517:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9617429a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353981312:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096587.343518:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096587.343527:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787096587.343551:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096587.343557:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787096587.343565:0:6476:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787096587.343579:0:6484:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787096587.343586:0:6474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353981184 00000100:00100000:0.0:1787096587.343592:0:6474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353981184 00000100:00100000:1.0:1787096587.343605:0:8380:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353981056 00000100:00100000:1.0:1787096587.343611:0:8380:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353981056 00010000:00080000:3.0:1787096587.343619:0:3637:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff96186dfbad80 x1873906353980672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787096603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787096587.343639:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96186dfbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353980672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787096587.343643:0:6474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353981312 00000100:00100000:0.0:1787096587.343648:0:6474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353981312 00000100:00100000:1.0:1787096587.343670:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787096587.343680:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353980800 00000100:00100000:3.0:1787096587.343686:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353980800 00000100:00100000:1.0:1787096587.343688:0:8380:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+14:3636:x1873906353981184:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096587.343693:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1787096587.343709:0:8380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1787096587.343710:0:6474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9618589cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+14:3634:x1873906353981056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096587.343722:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096587.343742:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c114 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x5:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa979d75fc166c10d expref: 14 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096587.343744:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4200/0xa979d75fc166c130 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa979d75fc166c129 expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096587.343745:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787096587.343763:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353980800:12345-0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1787096587.343799:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff96184a9ea200) 00010000:00010000:1.0:1787096587.343803:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff961742a1ef00) 00000004:00000024:3.0:1787096587.343824:0:7418:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446375424 avail 1300135936 00010000:00010000:0.0:1787096587.343829:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096587.343833:0:8380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787096587.343907:0:6474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9618589cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3634:x1873906353981056:12345-0@lo:103:ldlm_bl.0 Request processed in 204us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096587.343914:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1873906353980800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 154us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096587.343917:0:8380:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+12:3636:x1873906353981184:12345-0@lo:103:ldlm_bl.0 Request processed in 235us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096587.343933:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787096587.343940:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787096587.343951:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787096587.343994:0:3637:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3637:1873906353980800:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1787096587.344049:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787096587.344060:0:8380:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3636:x1873906353981312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096587.344071:0:8380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096587.344086:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4ac00/0xa979d75fc166c0f8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa979d75fc166c0f1 expref: 10 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096587.344101:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:1.0:1787096587.344105:0:8380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787096587.344110:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9617429a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353981056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787096587.344150:0:8380:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+9:3636:x1873906353981312:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096587.344157:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787096587.344197:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9617429a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353981312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787096587.344215:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9617429a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3636:1873906353981184:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096587.534647:0:7858:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787096588.159629:0:22520:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 24a: reject --ec with --comp-add ======= 19:43:06 (1787096586) 00000100:00100000:2.0:1787096588.237288:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096588.237354:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345510016 00000100:00100000:0.0:1787096588.237367:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345510016 00000100:00100000:0.0:1787096588.237477:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 201 00000100:00100000:0.0:1787096588.237491:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+5:35547:x1873906345510016:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1787096588.237519:0:8109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096588.237545:0:8109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166c137 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b20c6 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.237627:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166c13e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.237652:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166c13e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.237669:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166c13e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096588.237730:0:8109:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787096588.237735:0:8109:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787096588.237760:0:8109:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166c13e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.237816:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166c137 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20c6 expref: 7 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.237835:0:8109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166c13e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20c6 expref: 6 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.237846:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:0.0:1787096588.237850:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096588.237854:0:8109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340fe00, rc 0) 00000100:00100000:0.0:1787096588.238107:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+6:35547:x1873906345510016:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 609us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096588.238120:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 201 00000100:00100000:0.0:1787096588.239945:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096588.240850:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345510144 00000100:00100000:1.0:1787096588.240860:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345510144 00000100:00100000:1.0:1787096588.240912:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 202 00000100:00100000:1.0:1787096588.240921:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+6:35547:x1873906345510144:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096588.240942:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096588.240963:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c145 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b20cd expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241032:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166c14c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241049:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166c14c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241074:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166c14c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241192:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c153 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241210:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241219:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241571:0:9989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166c14c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241580:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166c14c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241586:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166c14c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241592:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166c14c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241597:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf5e00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096588.241601:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166c14c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241610:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166c14c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241624:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:1.0:1787096588.241639:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.241644:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166c14c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241649:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166c14c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241664:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c153 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241668:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c153 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241672:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c153 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241675:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf5600 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096588.241677:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c153 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241680:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c153 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241684:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2e9bf99 (ffff961742a1e900) 00010000:00010000:1.0:1787096588.241686:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.241687:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c153 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241690:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c153 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241727:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c145 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20cd expref: 7 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241742:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:1.0:1787096588.241744:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.241747:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20cd expref: 7 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.241754:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf5c00, rc 0) 00000100:00100000:1.0:1787096588.241827:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+6:35547:x1873906345510144:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 907us (1890us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096588.241835:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 202 00000100:00100000:2.0:1787096588.244067:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096588.244132:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345510400 00000100:00100000:1.0:1787096588.244142:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345510400 00000100:00100000:1.0:1787096588.244208:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 203 00000100:00100000:1.0:1787096588.244217:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+6:35547:x1873906345510400:12345-192.168.201.40@tcp:36:lfs.0 00010000:00010000:1.0:1787096588.244272:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096588.244288:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340fe00/0xa979d75fc166c13e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20c6 expref: 6 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.244304:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:1.0:1787096588.244307:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096588.244342:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c15a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.244351:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c15a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.244359:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c15a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.244384:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4a00/0xa979d75fc166c161 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.244389:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4a00/0xa979d75fc166c161 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.244395:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4a00/0xa979d75fc166c161 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787096588.244727:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787096588.244801:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x1:0x0].1, 64 off32832 00000004:00080000:1.0:1787096588.244809:0:6488:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff961741c7a600 with version 2 00000040:00080000:1.0:1787096588.244888:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787096588.244912:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x1:0x0].2, 64 off32896 00000004:00080000:1.0:1787096588.244918:0:6488:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff961742a4c900 with version 3 00000004:00080000:3.0:1787096588.245350:0:8450:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96187798db40 version 2 rpc_version 2 00000020:00100000:3.0:1787096588.245396:0:8450:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787096588.245409:0:8450:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9617429a3100 x1873906353981568/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787096588.245480:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9617429a3100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906353981568:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787096588.245560:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096588.245635:0:8450:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742d13cc0 going to sleep for 11 seconds 00000040:00080000:1.0:1787096588.245741:0:6488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787096588.245783:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353981568 00000100:00100000:3.0:1787096588.245797:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353981568 00000100:00100000:3.0:1787096588.245844:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787096588.245852:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8450:x1873906353981568:12345-0@lo:1000:osp_up1-0.0 00000040:00080000:1.0:1787096588.246034:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x1:0x0].1, 64 off32832 00000040:00080000:1.0:1787096588.246313:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].1, 2152 off34920 00000040:00080000:1.0:1787096588.247009:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].1, 2352 off35120 00000004:00080000:1.0:1787096588.247019:0:6488:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff961741c7a240 with version 4 00010000:00010000:3.0:1787096588.250632:0:7400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166c0ff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa979d75fc166c106 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096588.250649:0:7400:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166c0ff lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa979d75fc166c106 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.250693:0:7400:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166c0ff lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166c106 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.250701:0:7400:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096588.250731:0:7400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff961845b4b600/0xa979d75fc166c0ff lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166c106 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.250752:0:7400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340f800/0xa979d75fc166bf4d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0xa979d75fc166bf54 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096588.250760:0:7400:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340f800/0xa979d75fc166bf4d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0xa979d75fc166bf54 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.250792:0:7400:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340f800/0xa979d75fc166bf4d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bf54 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.250799:0:7400:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096588.250806:0:7400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff96174340f800/0xa979d75fc166bf4d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0xa979d75fc166bf54 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787096588.250840:0:7400:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967326 is committed 00000001:00080000:3.0:1787096588.250867:0:7400:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967325 is committed 00000020:00080000:3.0:1787096588.250901:0:7400:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff96187cad6780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787096588.250905:0:7400:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff961845354200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff96187cad6000 00000020:00080000:3.0:1787096588.250909:0:7400:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].5 00010000:00010000:1.0:1787096588.250910:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e200/0xa979d75fc166bf2a lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787096588.250911:0:7400:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff961845354800 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9617410cf200 00000020:00080000:3.0:1787096588.250920:0:7400:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].5 00010000:00010000:1.0:1787096588.250928:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e200/0xa979d75fc166bf2a lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.250936:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e200/0xa979d75fc166bf2a lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787096588.250939:0:7400:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff961742a35240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787096588.250946:0:7400:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9618581c3900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff961742a35900 00000020:00080000:3.0:1787096588.250949:0:7400:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000401:0x3:0x0].4 00000020:00080000:3.0:1787096588.250951:0:7400:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9618581c3600 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff961742ca4a00 00000020:00080000:3.0:1787096588.250954:0:7400:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000400:0x3:0x0].4 00010000:00010000:1.0:1787096588.250960:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340e200 already unused, calling callback (ffffffffc17594f0) 00000020:00080000:3.0:1787096588.250971:0:7400:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 3 batchid updated 00010000:00010000:1.0:1787096588.250973:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e200/0xa979d75fc166bf2a lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.250982:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e200/0xa979d75fc166bf2a lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251006:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x5:0x0].0xae2548a7 (ffff961741932300) 00000100:00100000:3.0:1787096588.251007:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9617429a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353981696:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1787096588.251011:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.251018:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e200/0xa979d75fc166bf2a lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251025:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340e200/0xa979d75fc166bf2a lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x5:0x0].0xae2548a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251051:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166bfc4 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251058:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166bfc4 lrc: 2/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251064:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166bfc4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251070:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4e00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096588.251073:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166bfc4 lrc: 3/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251088:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166bfc4 lrc: 4/0,0 mode: TXN/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251097:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x5:0x0].0x0 (ffff961742a1e300) 00010000:00010000:1.0:1787096588.251100:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.251111:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166bfc4 lrc: 2/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251117:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4e00/0xa979d75fc166bfc4 lrc: 0/0,0 mode: --/TXN res: [0x240000402:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251133:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166bfcb lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251140:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166bfcb lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251147:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166bfcb lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251153:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4000 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096588.251157:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166bfcb lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251166:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166bfcb lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096588.251176:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787096588.251188:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0x0 (ffff961742a1e200) 00010000:00010000:1.0:1787096588.251191:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.251194:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166bfcb lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251201:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4000/0xa979d75fc166bfcb lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251233:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c057 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096588.251237:0:3634:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1787096588.251244:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c057 lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096588.251247:0:3634:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9617429a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353981824:0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1787096588.251260:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c057 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251266:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4400 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096588.251269:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c057 lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251276:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c057 lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251284:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0xdd5a5043 (ffff961742a1e700) 00010000:00010000:1.0:1787096588.251287:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.251290:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c057 lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251296:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96186ddf4400/0xa979d75fc166c057 lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251309:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166c0dc lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251316:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166c0dc lrc: 2/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096588.251318:0:3634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787096588.251327:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166c0dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251333:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96174340fc00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096588.251337:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166c0dc lrc: 3/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787096588.251352:0:7425:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 5 committed batchid 3 00010000:00010000:1.0:1787096588.251355:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166c0dc lrc: 4/0,0 mode: TXN/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251366:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x6:0x0].0xdd5a5043 (ffff961742a1e700) 00010000:00010000:1.0:1787096588.251368:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.251372:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166c0dc lrc: 2/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251378:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fc00/0xa979d75fc166c0dc lrc: 0/0,0 mode: --/TXN res: [0x240000400:0x6:0x0].0xdd5a5043 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096588.251619:0:6474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353981696 00000100:00100000:2.0:1787096588.251628:0:6474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353981696 00000100:00100000:2.0:1787096588.251700:0:6474:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353981824 00000100:00100000:2.0:1787096588.251704:0:6474:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353981824 00000100:00100000:1.0:1787096588.251772:0:8380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787096588.251784:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787096588.251790:0:8380:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+10:3634:x1873906353981696:12345-0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1787096588.251799:0:6474:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+10:3634:x1873906353981824:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:1.0:1787096588.251807:0:8380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096588.251811:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096588.251827:0:8380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5000/0xa979d75fc166c106 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xb790e34b bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa979d75fc166c0ff expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.251829:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340f600/0xa979d75fc166bf54 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9280d55e bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0xa979d75fc166bf4d expref: 10 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.251858:0:8380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb790e34b (ffff961742a1eb00) 00010000:00010000:2.0:1787096588.251861:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9280d55e (ffff961741932c00) 00010000:00010000:1.0:1787096588.251874:0:8380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096588.251875:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:3.0:1787096588.251923:0:7425:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff961742d13780 with version 10 00000100:00100000:1.0:1787096588.251930:0:8380:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3634:x1873906353981696:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 146us (756us total) trans 0 rc 0/0 00000020:00080000:3.0:1787096588.251939:0:7425:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 1 cancel update log [0x200000401:0x3:0x0].1: rc = 0 00000020:00080000:3.0:1787096588.251989:0:7425:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 1 cancel update log [0x240000400:0x3:0x0].1: rc = 0 00000100:00100000:1.0:1787096588.252000:0:8380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000004:00080000:3.0:1787096588.252013:0:7425:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff96184786a180 with version 11 00000020:00080000:3.0:1787096588.252016:0:7425:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 2 cancel update log [0x200000401:0x3:0x0].2: rc = 0 00000020:00080000:3.0:1787096588.252041:0:7425:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 2 cancel update log [0x240000400:0x3:0x0].2: rc = 0 00000100:00100000:1.0:1787096588.252054:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9617429a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353981696:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:2.0:1787096588.252136:0:6474:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+7:3634:x1873906353981824:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 343us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096588.252161:0:3634:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9617429a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3634:1873906353981824:0@lo:103:jbd2/dm-1-8.0 00000004:00080000:3.0:1787096588.252164:0:7425:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff96187798d3c0 with version 12 00000020:00080000:3.0:1787096588.252168:0:7425:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 3 cancel update log [0x200000401:0x3:0x0].3: rc = 0 00000020:00080000:3.0:1787096588.252184:0:7425:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 3 cancel update log [0x240000400:0x3:0x0].3: rc = 0 00000020:00080000:3.0:1787096588.252189:0:7425:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 3 00000004:00080000:3.0:1787096588.252199:0:7416:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96184550da80 version 10 rpc_version 10 00000100:00100000:2.0:1787096588.252206:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000020:00100000:3.0:1787096588.252216:0:7416:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787096588.252223:0:7416:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9617429a1180 x1873906353982080/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787096588.252237:0:7416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9617429a1180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353982080:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096588.252282:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096588.252314:0:7416:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187798d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787096588.252320:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353982080 00000100:00100000:2.0:1787096588.252324:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8450:x1873906353981568:12345-0@lo:1000:osp_up1-0.0 Request processed in 6470us (6760us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1787096588.252325:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353982080 00000100:00100000:2.0:1787096588.252334:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1787096588.252366:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787096588.252376:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+7:7416:x1873906353982080:12345-0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1787096588.252394:0:8450:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967326 committed transno 4294967326 00000100:00100000:3.0:1787096588.252398:0:8450:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967326 gen 2 00000100:00100000:3.0:1787096588.252410:0:8450:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9617429a3100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906353981568:0@lo:1000:osp_up1-0.0 00000004:00080000:3.0:1787096588.252459:0:8450:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96187798db40 version 3 rpc_version 3 00000020:00100000:3.0:1787096588.252471:0:8450:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787096588.252476:0:8450:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9617429a3100 x1873906353982336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 1312/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787096588.252487:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9617429a3100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906353982336:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787096588.252520:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096588.252535:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7416:x1873906353982080:12345-0@lo:1000:osp_up0-1.0 Request processed in 160us (253us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787096588.252543:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787096588.252548:0:8450:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187798d000 going to sleep for 11 seconds 00000100:00100000:2.0:1787096588.252561:0:6493:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353982336 00000100:00100000:2.0:1787096588.252566:0:6493:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353982336 00000100:00100000:2.0:1787096588.252595:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787096588.252604:0:6493:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8450:x1873906353982336:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787096588.252616:0:7416:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9617429a1180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353982080:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1787096588.252627:0:7416:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96184550da80 version 11 rpc_version 11 00000020:00100000:3.0:1787096588.252640:0:7416:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787096588.252651:0:7416:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9617429a1500 x1873906353982592/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787096588.252661:0:7416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9617429a1500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353982592:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096588.252686:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096588.252699:0:7416:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187798d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096588.252711:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353982592 00000100:00100000:3.0:1787096588.252713:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353982592 00000100:00100000:3.0:1787096588.252732:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787096588.252737:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96186dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+8:7416:x1873906353982592:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096588.252821:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96186dfbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7416:x1873906353982592:12345-0@lo:1000:osp_up0-1.0 Request processed in 84us (133us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787096588.252826:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787096588.252849:0:7416:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9617429a1500 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353982592:0@lo:1000:osp_up0-1.0 00000004:00080000:3.0:1787096588.252855:0:7416:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96184550da80 version 12 rpc_version 12 00000020:00100000:3.0:1787096588.252868:0:7416:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787096588.252872:0:7416:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff961850196a00 x1873906353982848/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787096588.252883:0:7416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850196a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353982848:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096588.252905:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096588.252920:0:7416:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187798d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096588.253081:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353982848 00000100:00100000:3.0:1787096588.253086:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353982848 00000100:00100000:3.0:1787096588.253109:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787096588.253118:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+9:7416:x1873906353982848:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096588.253197:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850196300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:7416:x1873906353982848:12345-0@lo:1000:osp_up0-1.0 Request processed in 82us (292us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1787096588.253212:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787096588.253241:0:7416:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850196a00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353982848:0@lo:1000:osp_up0-1.0 00000001:00080000:2.0:1787096588.254622:0:7400:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967327 is committed 00000020:00080000:2.0:1787096588.254636:0:7400:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 5 batchid updated 00000020:00080000:3.0:1787096588.254655:0:7425:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 5 00000004:00080000:3.0:1787096588.254688:0:7425:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff96187798d6c0 with version 13 00000020:00080000:3.0:1787096588.254696:0:7425:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 4 cancel update log [0x200000401:0x3:0x0].4: rc = 0 00000020:00080000:3.0:1787096588.254732:0:7425:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 4 cancel update log [0x240000400:0x3:0x0].4: rc = 0 00000100:00100000:2.0:1787096588.254740:0:6493:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8450:x1873906353982336:12345-0@lo:1000:osp_up1-0.0 Request processed in 2135us (2216us total) trans 4294967327 rc 0/0 00000004:00080000:3.0:1787096588.254753:0:7425:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff96187798dc00 with version 14 00000020:00080000:3.0:1787096588.254757:0:7425:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 5 cancel update log [0x200000401:0x3:0x0].5: rc = 0 00000100:00100000:2.0:1787096588.254773:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000020:00080000:3.0:1787096588.254788:0:7425:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 5 cancel update log [0x240000400:0x3:0x0].5: rc = 0 00000020:00080000:3.0:1787096588.254795:0:7425:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 5 00000004:00080000:3.0:1787096588.254804:0:7416:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96184550da80 version 13 rpc_version 13 00000004:00080000:2.0:1787096588.254816:0:8450:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967327 committed transno 4294967327 00000020:00100000:3.0:1787096588.254820:0:7416:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787096588.254822:0:8450:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967327 gen 2 00000100:00100000:3.0:1787096588.254827:0:7416:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff961850195180 x1873906353983104/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096588.254836:0:8450:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9617429a3100 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906353982336:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787096588.254841:0:7416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850195180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353983104:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1787096588.254862:0:8450:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96187798db40 version 4 rpc_version 4 00000100:00100000:3.0:1787096588.254867:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00100000:2.0:1787096588.254887:0:8450:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787096588.254889:0:7416:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741f0e900 going to sleep for 11 seconds 00000100:00100000:2.0:1787096588.254894:0:8450:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff961742db3480 x1873906353983360/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787096588.254899:0:6494:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353983104 00000100:00100000:3.0:1787096588.254902:0:6494:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353983104 00000100:00100000:2.0:1787096588.254913:0:8450:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961742db3480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906353983360:0@lo:1000:osp_up1-0.0 00000100:00100000:3.0:1787096588.254922:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787096588.254928:0:6494:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961850195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+10:7416:x1873906353983104:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096588.254953:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096588.254981:0:8450:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742d13f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787096588.254993:0:6494:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961850195880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+11:7416:x1873906353983104:12345-0@lo:1000:osp_up0-1.0 Request processed in 66us (126us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1787096588.254998:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353983360 00000100:00100000:3.0:1787096588.255000:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787096588.255003:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353983360 00000100:00100000:3.0:1787096588.255030:0:7416:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850195180 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353983104:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096588.255039:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000004:00080000:3.0:1787096588.255045:0:7416:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff96184550da80 version 14 rpc_version 14 00000100:00100000:2.0:1787096588.255050:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:8450:x1873906353983360:12345-0@lo:1000:osp_up1-0.0 00000020:00100000:3.0:1787096588.255059:0:7416:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1787096588.255065:0:7416:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff961850196680 x1873906353983616/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787096588.255079:0:7416:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850196680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353983616:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096588.255106:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096588.255118:0:7416:0:(client.c:2692:ptlrpc_set_wait()) set ffff961741f0e900 going to sleep for 11 seconds 00000100:00100000:2.0:1787096588.256232:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8450:x1873906353983360:12345-0@lo:1000:osp_up1-0.0 Request processed in 1185us (1278us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787096588.256240:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787096588.256258:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353983616 00000100:00100000:2.0:1787096588.256263:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353983616 00000100:00100000:2.0:1787096588.256286:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1787096588.256293:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9618581fac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+11:7416:x1873906353983616:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096588.256361:0:8450:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961742db3480 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:8450:1873906353983360:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787096588.256378:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9618581fac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:7416:x1873906353983616:12345-0@lo:1000:osp_up0-1.0 Request processed in 84us (1268us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787096588.256386:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787096588.256404:0:7416:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850196680 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7416:1873906353983616:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1787096588.256459:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5000/0xa979d75fc166c168 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256472:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5000/0xa979d75fc166c168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256482:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5000/0xa979d75fc166c168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256496:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166c16f lrc: 3/0,1 mode: --/PW res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256501:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166c16f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256506:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166c16f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256528:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff96186ddf4000/0xa979d75fc166c176 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256532:0:6488:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff96186ddf4000/0xa979d75fc166c176 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256538:0:6488:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff96186ddf4000/0xa979d75fc166c176 lrc: 3/0,1 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096588.256548:0:6488:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f68a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6488:1873906353983744:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1787096588.256602:0:6488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096588.256620:0:7418:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353983744 00000100:00100000:2.0:1787096588.256623:0:7418:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353983744 00000100:00100000:1.0:1787096588.256625:0:6488:0:(client.c:2692:ptlrpc_set_wait()) set ffff961742a4c300 going to sleep for 11 seconds 00000100:00100000:2.0:1787096588.256647:0:7418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1787096588.256650:0:7418:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6488:x1873906353983744:12345-0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787096588.256658:0:7418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096588.256668:0:7418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4bc00/0xa979d75fc166c17d lrc: 2/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa979d75fc166c176 expref: -99 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.256682:0:7418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4bc00/0xa979d75fc166c17d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0xa979d75fc166c176 expref: 7 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.256690:0:7418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4bc00/0xa979d75fc166c17d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166c176 expref: 7 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.256696:0:7418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff961742a26d00) 00010000:00010000:2.0:1787096588.256698:0:7418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096588.256700:0:7418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4bc00, rc 0) 00000100:00100000:2.0:1787096588.256726:0:7418:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6488:x1873906353983744:12345-0@lo:101:mdt00_000.0 Request processed in 75us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096588.256730:0:7418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787096588.256753:0:6488:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f68a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6488:1873906353983744:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1787096588.256775:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff96186ddf4000/0xa979d75fc166c176 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166c17d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256793:0:6488:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff96186ddf4000/0xa979d75fc166c176 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0xa979d75fc166c17d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096588.256810:0:6488:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cfaf62c2 reply state 00000000ab5c1ee9 transno 4294967364 ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166c16f lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256820:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4400/0xa979d75fc166c16f lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256827:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff961742a1e700) 00010000:00010000:1.0:1787096588.256830:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096588.256833:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787096588.256839:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff96186ddf4000/0xa979d75fc166c176 lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166c17d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256846:0:6488:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff96186ddf4000/0xa979d75fc166c176 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0xa979d75fc166c17d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787096588.256854:0:6488:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x2:0x0] 00000004:00010000:1.0:1787096588.256859:0:6488:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cfaf62c2 reply state 00000000ab5c1ee9 transno 4294967364 ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5000/0xa979d75fc166c168 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256865:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5000/0xa979d75fc166c168 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256869:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff961742a1eb00) 00010000:00010000:1.0:1787096588.256871:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096588.256873:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787096588.256877:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4096 00010000:00010000:1.0:1787096588.256891:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c15a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256897:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c15a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256903:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c15a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256909:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c15a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256915:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf5200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096588.256920:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c15a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256927:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c15a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.256937:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:1.0:1787096588.256939:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.256998:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c15a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.257007:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c15a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096588.257018:0:6488:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cfaf62c2 reply state 00000000ab5c1ee9 transno 4294967364 ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4a00/0xa979d75fc166c161 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.257027:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4a00/0xa979d75fc166c161 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.257046:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2e9bf99 (ffff961742a1e100) 00010000:00010000:1.0:1787096588.257048:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096588.257051:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1787096588.257112:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742db2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+7:35547:x1873906345510400:12345-192.168.201.40@tcp:36:lfs.0 Request processed in 12896us (13054us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1787096588.257117:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 203 00000100:00100000:2.0:1787096588.269341:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096588.269395:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345510528 00000100:00100000:0.0:1787096588.269412:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345510528 00000100:00100000:0.0:1787096588.269522:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 204 00000100:00100000:0.0:1787096588.269533:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+7:35550:x1873906345510528:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1787096588.269562:0:8109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096588.269585:0:8109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166c184 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b20d4 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.269669:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166c18b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.269685:0:8109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166c18b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.269696:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166c18b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096588.269755:0:8109:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787096588.269758:0:8109:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787096588.269792:0:8109:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166c18b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.269815:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96174340ee00/0xa979d75fc166c184 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20d4 expref: 9 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.269829:0:8109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96174340e000/0xa979d75fc166c18b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20d4 expref: 8 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.269837:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:0.0:1787096588.269839:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096588.269842:0:8109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340e000, rc 0) 00000100:00100000:0.0:1787096588.269918:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+8:35550:x1873906345510528:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 387us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096588.269923:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 204 00000100:00100000:2.0:1787096588.274175:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096588.274226:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345510656 00000100:00100000:1.0:1787096588.274237:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345510656 00000100:00100000:1.0:1787096588.274290:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 205 00000100:00100000:1.0:1787096588.274301:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+8:35550:x1873906345510656:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096588.274320:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096588.274337:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c192 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b20db expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274399:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4e00/0xa979d75fc166c199 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274414:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4e00/0xa979d75fc166c199 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274425:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4e00/0xa979d75fc166c199 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274435:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274478:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274504:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274576:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c1a7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274584:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274591:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096588.274657:0:9989:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x12:0x0]: returning size 4096 00000004:00200000:1.0:1787096588.274663:0:9989:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787096588.274680:0:9989:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c1a7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274689:0:9989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4e00/0xa979d75fc166c199 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274694:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4e00/0xa979d75fc166c199 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274698:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4e00/0xa979d75fc166c199 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274702:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4e00/0xa979d75fc166c199 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274705:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4e00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096588.274707:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4e00/0xa979d75fc166c199 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274717:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4e00/0xa979d75fc166c199 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274726:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9618472ca600) 00010000:00010000:1.0:1787096588.274727:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.274730:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4e00/0xa979d75fc166c199 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274735:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4e00/0xa979d75fc166c199 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274743:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274747:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274751:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274753:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf5c00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096588.274755:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274758:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274773:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2e9bf99 (ffff961742a1e100) 00010000:00010000:1.0:1787096588.274776:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.274779:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274794:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274818:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c192 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20db expref: 10 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274828:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5600/0xa979d75fc166c1a7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x12:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20db expref: 9 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.274835:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff961742a1eb00) 00010000:00010000:1.0:1787096588.274837:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787096588.274839:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf5600, rc 0) 00000100:00100000:1.0:1787096588.274897:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+9:35550:x1873906345510656:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 599us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096588.274914:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 205 00000100:00100000:2.0:1787096588.276303:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096588.276349:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345510784 00000100:00100000:1.0:1787096588.276358:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345510784 00000100:00100000:1.0:1787096588.276419:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 206 00000100:00100000:1.0:1787096588.276430:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+9:35550:x1873906345510784:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096588.276758:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096588.276793:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166c1ae lrc: 2/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b20e2 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.276836:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4c00/0xa979d75fc166c1b5 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.276846:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4c00/0xa979d75fc166c1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.276864:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4c00/0xa979d75fc166c1b5 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096588.276905:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x2:0x0]: returning size 4096 00000004:00200000:1.0:1787096588.276909:0:6488:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787096588.276934:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166c1ae lrc: 0/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20e2 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.276948:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4c00/0xa979d75fc166c1b5 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20e2 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.276955:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff961742a1e700) 00010000:00010000:1.0:1787096588.276958:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787096588.276961:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf4c00, rc 0) 00000100:00100000:1.0:1787096588.277004:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+10:35550:x1873906345510784:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 577us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096588.277011:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 206 00000100:00100000:2.0:1787096588.277895:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:0.0:1787096588.277937:0:8109:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345510912 00000100:00100000:0.0:1787096588.277948:0:8109:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345510912 00000100:00100000:0.0:1787096588.278001:0:8109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 207 00000100:00100000:0.0:1787096588.278013:0:8109:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+5:35550:x1873906345510912:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:0.0:1787096588.278035:0:8109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096588.278054:0:8109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fa00/0xa979d75fc166c1bc lrc: 2/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b20e9 expref: -99 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.278111:0:8109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c1c3 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8109 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.278142:0:8109:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4bc00/0xa979d75fc166c17d lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0xa979d75fc166c176 expref: 6 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.278152:0:8109:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c1c3 lrc: 4/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.278191:0:8109:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4bc00/0xa979d75fc166c17d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0xa979d75fc166c176 expref: 6 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096588.278211:0:8109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff96187c811880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8109:1873906353983872:0@lo:104: 00000100:00100000:0.0:1787096588.278261:0:8109:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096588.278319:0:7411:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353983872 00000100:00100000:1.0:1787096588.278324:0:7411:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353983872 00000100:00100000:0.0:1787096588.278337:0:8109:0:(client.c:2692:ptlrpc_set_wait()) set ffff9618757cb780 going to sleep for 11 seconds 00000100:00100000:1.0:1787096588.278362:0:7411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787096588.278369:0:7411:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:8109:x1873906353983872:12345-0@lo:104: 00010000:00010000:1.0:1787096588.278381:0:7411:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff96186ddf4000/0xa979d75fc166c176 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa979d75fc166c17d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.278467:0:7411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787096588.278475:0:7411:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-mdtlov_UUID+4:8109:x1873906353983872:12345-0@lo:104: Request processed in 106us (213us total) trans 0 rc 0/0 00010000:00010000:3.0:1787096588.278489:0:10297:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1787096588.278492:0:8109:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff96187c811880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001_UUID:8109:1873906353983872:0@lo:104: 00000100:00100000:1.0:1787096588.278495:0:7411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:3.0:1787096588.278499:0:10297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff96186ddf4000/0xa979d75fc166c176 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0xa979d75fc166c17d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.278511:0:10297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4000 already unused, calling callback (ffffffffc1765ee0) 00010000:00010000:3.0:1787096588.278517:0:10297:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff96186ddf4000/0xa979d75fc166c176 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0xa979d75fc166c17d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.278521:0:8109:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c1c3 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096588.278535:0:10297:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff96186ddf4000/0xa979d75fc166c176 lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0xa979d75fc166c17d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.278572:0:10297:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff96186ddf4000/0xa979d75fc166c176 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166c17d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.278580:0:10297:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787096588.278615:0:10297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff96186ddf4000/0xa979d75fc166c176 lrc: 1/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166c17d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.278633:0:10297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff96186ddf4000/0xa979d75fc166c176 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0xa979d75fc166c17d expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096588.278650:0:3636:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961850197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353984000:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096588.278656:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096588.278659:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096588.278662:0:10297:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787096588.278692:0:3636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096588.278741:0:7412:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906353984000 00000100:00100000:2.0:1787096588.278746:0:7412:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906353984000 00010000:00010000:2.0:1787096588.278774:0:7412:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4bc00/0xa979d75fc166c17d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0xa979d75fc166c176 expref: 7 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096588.278811:0:7412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787096588.278817:0:7412:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+7:3636:x1873906353984000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787096588.278828:0:7412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:3.0:1787096588.280635:0:7400:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967328 is committed 00010000:00010000:2.0:1787096588.280731:0:7412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff961845b4bc00/0xa979d75fc166c17d lrc: 0/0,0 mode: --/PW res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0xa979d75fc166c176 expref: 6 pid: 7418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.280750:0:7412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff961742a26d00) 00010000:00010000:2.0:1787096588.280756:0:7412:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c1c3 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.280775:0:7412:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c1c3 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.280784:0:7412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c1c3 lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.280816:0:7412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096588.280844:0:8109:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c1c3 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.280855:0:8109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c1c3 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8109 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096588.280888:0:7412:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848f68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1873906353984000:12345-0@lo:103:ldlm_bl.0 Request processed in 2069us (2194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096588.280898:0:7412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00200000:0.0:1787096588.280911:0:8109:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x2:0x0]: returning size 4096 00000004:00200000:0.0:1787096588.280918:0:8109:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000100:00100000:1.0:1787096588.280924:0:3636:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961850197480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3636:1873906353984000:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096588.280965:0:8109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff96174340fa00/0xa979d75fc166c1bc lrc: 0/0,0 mode: --/CR res: [0x240000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20e9 expref: 7 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.280981:0:8109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff96174340f400/0xa979d75fc166c1c3 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x2:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20e9 expref: 6 pid: 8109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096588.281001:0:8109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x2:0x0].0x0 (ffff961742a26d00) 00010000:00010000:0.0:1787096588.281004:0:8109:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787096588.281007:0:8109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96174340f400, rc 0) 00000100:00100000:0.0:1787096588.281061:0:8109:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:70e19547-606a-4706-b016-3476e377d7df+6:35550:x1873906345510912:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 3052us (3167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096588.281069:0:8109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 207 00000100:00100000:2.0:1787096588.282338:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096588.282391:0:9989:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345511040 00000100:00100000:1.0:1787096588.282401:0:9989:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345511040 00000100:00100000:1.0:1787096588.282507:0:9989:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 208 00000100:00100000:1.0:1787096588.282520:0:9989:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9617429a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+10:35550:x1873906345511040:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096588.282543:0:9989:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096588.282563:0:9989:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166c1ca lrc: 2/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b20f0 expref: -99 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282630:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c1d1 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282644:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c1d1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282655:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c1d1 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282672:0:9989:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1d8 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x2:0x0].0x45ad699a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282680:0:9989:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282688:0:9989:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282791:0:9989:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c1d1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282800:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c1d1 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282808:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c1d1 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282814:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c1d1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282821:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf5200 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096588.282825:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c1d1 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282833:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c1d1 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282845:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff961742a1e700) 00010000:00010000:1.0:1787096588.282848:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.282852:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c1d1 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282857:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5200/0xa979d75fc166c1d1 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282868:0:9989:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282874:0:9989:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1d8 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282891:0:9989:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282896:0:9989:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf5c00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096588.282899:0:9989:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282905:0:9989:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1d8 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282913:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x45ad699a (ffff961742a1e300) 00010000:00010000:1.0:1787096588.282915:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.282917:0:9989:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1d8 lrc: 2/0,0 mode: --/PR res: [0x200000400:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282923:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5c00/0xa979d75fc166c1d8 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9989 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282953:0:9989:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166c1ca lrc: 1/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20f0 expref: 11 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282962:0:9989:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff961742a1e700) 00010000:00010000:1.0:1787096588.282965:0:9989:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.282968:0:9989:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5e00/0xa979d75fc166c1ca lrc: 0/0,0 mode: --/CR res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20f0 expref: 11 pid: 9989 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.282976:0:9989:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf5e00, rc 0) 00000100:00100000:1.0:1787096588.283025:0:9989:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9617429a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:70e19547-606a-4706-b016-3476e377d7df+10:35550:x1873906345511040:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 508us (690us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096588.283040:0:9989:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 208 00000100:00100000:2.0:1787096588.284804:0:3629:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096588.284890:0:6488:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345511296 00000100:00100000:1.0:1787096588.284900:0:6488:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345511296 00000100:00100000:1.0:1787096588.284937:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 209 00000100:00100000:1.0:1787096588.284944:0:6488:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961742d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+10:35550:x1873906345511296:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:1.0:1787096588.284961:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096588.284962:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787096588.284978:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4c00/0xa979d75fc166c1b5 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20e2 expref: 10 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.284990:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff961742a1e700) 00010000:00010000:1.0:1787096588.284993:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096588.285000:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4e00/0xa979d75fc166c1df lrc: 2/0,0 mode: --/CW res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b20f7 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285075:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166c1e6 lrc: 3/0,1 mode: --/CW res: [0x200000400:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285086:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166c1e6 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285092:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166c1e6 lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285102:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c1ed lrc: 3/0,1 mode: --/PW res: [0x200000400:0x2:0x0].0x45ad699a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285106:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c1ed lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285124:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c1ed lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285525:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166c1f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285534:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166c1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285543:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166c1f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096588.285553:0:6488:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x13:0x0]: returning size 0 00010000:00010000:1.0:1787096588.285581:0:6488:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166c1e6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285589:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166c1e6 lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285595:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166c1e6 lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285602:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166c1e6 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285608:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff96186ddf4800 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:1.0:1787096588.285612:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166c1e6 lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285619:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166c1e6 lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285637:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff961742a1e700) 00010000:00010000:1.0:1787096588.285640:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096588.285643:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166c1e6 lrc: 3/0,0 mode: --/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285649:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4800/0xa979d75fc166c1e6 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096588.285659:0:6488:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a1892c73 reply state 0000000026e41348 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c1ed lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285671:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5a00/0xa979d75fc166c1ed lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x45ad699a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285677:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x45ad699a (ffff961742a1e900) 00010000:00010000:1.0:1787096588.285679:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096588.285681:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787096588.285705:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf4e00/0xa979d75fc166c1df lrc: 0/0,0 mode: --/CW res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20f7 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285717:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166c1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20f7 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096588.285724:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff961742a1ed00) 00010000:00010000:1.0:1787096588.285727:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787096588.285729:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff96186ddf5400, rc 0) 00000100:00100000:1.0:1787096588.285801:0:6488:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961742d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:70e19547-606a-4706-b016-3476e377d7df+12:35550:x1873906345511296:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 857us (1003us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1787096588.285810:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 209 00000100:00100000:0.0:1787096588.287343:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:2.0:1787096588.287849:0:6489:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345511552 00000100:00100000:2.0:1787096588.287861:0:6489:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345511552 00000100:00100000:2.0:1787096588.287920:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 210 00000100:00100000:2.0:1787096588.287932:0:6489:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+12:35550:x1873906345511552:12345-192.168.201.40@tcp:101:lfs.0 00010000:00010000:2.0:1787096588.287959:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096588.287989:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166c202 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe2ded7f867b20fe expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.288115:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4aa00/0xa979d75fc166c209 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.288130:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166c1f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20f7 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.288148:0:6489:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4aa00/0xa979d75fc166c209 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.288192:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166c1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20f7 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.288206:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166c1f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20f7 expref: 13 pid: 6488 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096588.288223:0:6489:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff961848f4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6489:1873906353984128:192.168.201.40@tcp:104: 00000100:00100000:2.0:1787096588.288324:0:6489:0:(client.c:2692:ptlrpc_set_wait()) set ffff96187798d540 going to sleep for 11 seconds 00000100:00100000:2.0:1787096588.289540:0:6489:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff961848f4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6489:1873906353984128:192.168.201.40@tcp:104: 00010000:00010000:2.0:1787096588.289558:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4aa00/0xa979d75fc166c209 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096588.289707:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:3.0:1787096588.289823:0:6475:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345511680 00000100:00100000:3.0:1787096588.289835:0:6475:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345511680 00010000:00010000:3.0:1787096588.289867:0:6475:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166c1f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20f7 expref: 14 pid: 6488 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096588.289904:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 74 00000100:00100000:3.0:1787096588.289916:0:6475:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff961848ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70e19547-606a-4706-b016-3476e377d7df+14:2401:x1873906345511680:12345-192.168.201.40@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787096588.289927:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096588.289932:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166c1f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20f7 expref: 14 pid: 6488 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.289942:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166c1f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20f7 expref: 14 pid: 6488 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.289959:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff96186ddf5400/0xa979d75fc166c1f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20f7 expref: 14 pid: 6488 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.289972:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff961742a1ed00) 00010000:00010000:3.0:1787096588.289975:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4aa00/0xa979d75fc166c209 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.289992:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4aa00/0xa979d75fc166c209 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.289998:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4aa00/0xa979d75fc166c209 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096588.290022:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096588.290040:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4aa00/0xa979d75fc166c209 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.290047:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4aa00/0xa979d75fc166c209 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096588.290070:0:6475:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70e19547-606a-4706-b016-3476e377d7df+13:2401:x1873906345511680:12345-192.168.201.40@tcp:103:ldlm_bl.0 Request processed in 156us (363us total) trans 0 rc 0/0 00000004:00200000:2.0:1787096588.290075:0:6489:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x13:0x0]: returning size 0 00000100:00100000:3.0:1787096588.290080:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 74 00010000:00010000:2.0:1787096588.290242:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4aa00/0xa979d75fc166c209 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.290251:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4aa00/0xa979d75fc166c209 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.290257:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4aa00/0xa979d75fc166c209 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.290263:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff961845b4aa00 already unused, calling callback (ffffffffc17594f0) 00010000:00010000:2.0:1787096588.290268:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4aa00/0xa979d75fc166c209 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.290276:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4aa00/0xa979d75fc166c209 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.290284:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff961742a1ed00) 00010000:00010000:2.0:1787096588.290287:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787096588.290290:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4aa00/0xa979d75fc166c209 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.290296:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4aa00/0xa979d75fc166c209 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.290331:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166c202 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20fe expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.290340:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff961742a1ed00) 00010000:00010000:2.0:1787096588.290342:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787096588.290352:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff961845b4bc00/0xa979d75fc166c202 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.40@tcp remote: 0xe2ded7f867b20fe expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096588.290369:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff961845b4bc00, rc 0) 00000100:00100000:2.0:1787096588.290402:0:6489:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff961848ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:70e19547-606a-4706-b016-3476e377d7df+11:35550:x1873906345511552:12345-192.168.201.40@tcp:101:lfs.0 Request processed in 2474us (3065us total) trans 0 rc 301/301 00000100:00100000:2.0:1787096588.290409:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 210 00000100:00100000:0.0:1787096588.291870:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.40@tcp (source: 12345-192.168.201.40@tcp) 00000100:00100000:1.0:1787096588.291917:0:13534:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906345511936 00000100:00100000:1.0:1787096588.291924:0:13534:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906345511936 00000100:00100000:1.0:1787096588.291969:0:13534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.40@tcp, seq: 36 00000100:00100000:1.0:1787096588.291976:0:13534:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff96187c811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:70e19547-606a-4706-b016-3476e377d7df+11:35550:x1873906345511936:12345-192.168.201.40@tcp:35:lfs.0 00000100:00100000:1.0:1787096588.292203:0:13534:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff96187c811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:70e19547-606a-4706-b016-3476e377d7df+12:35550:x1873906345511936:12345-192.168.201.40@tcp:35:lfs.0 Request processed in 227us (337us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1787096588.292209:0:13534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.40@tcp, seq: 36 00010000:00010000:3.0:1787096588.558594:0:6477:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787096588.970292:0:22568:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_24a: @@@@@@ FAIL: setstripe failed Debug log: 1296 lines, 1296 kept, 0 dropped, 0 bad.