00000100:00100000:0.0F:1787096563.161197:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0F:1787096563.161240:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352853760 00000100:00100000:2.0:1787096563.161253:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352853760 00000100:00080000:0.0:1787096563.161289:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787096563.161306:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 229 00000100:00100000:2.0:1787096563.161314:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7483ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+20:36552:x1873906352853760:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:2.0:1787096563.161337:0:7414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096563.161355:0:7414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b44331 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6da5 expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.161540:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44338 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.161555:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44338 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.161567:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44338 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096563.161642:0:7414:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x13:0x0]: returning size 4096 00000004:00200000:2.0:1787096563.161646:0:7414:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:2.0:1787096563.161663:0:7414:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44338 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.161682:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b44331 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6da5 expref: 22 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.161691:0:7414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44338 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x13:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6da5 expref: 21 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.161697:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9c9c41b55300) 00010000:00010000:2.0:1787096563.161700:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787096563.161702:0:7414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4b400, rc 0) 00000100:00100000:2.0:1787096563.161751:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7483ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+21:36552:x1873906352853760:12345-192.168.203.27@tcp:101:rm.0 Request processed in 439us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096563.161756:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 229 00000100:00100000:0.0:1787096563.162679:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096563.162718:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352853888 00000100:00100000:2.0:1787096563.162723:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352853888 00000100:00100000:2.0:1787096563.162760:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 230 00000100:00100000:2.0:1787096563.162781:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7483a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+21:36552:x1873906352853888:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:2.0:1787096563.162790:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096563.162799:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b4433f lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6dac expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.162824:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b44346 lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.162832:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b44346 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.162840:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b44346 lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096563.162859:0:6481:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x5:0x0]: returning size 4096 00000004:00200000:2.0:1787096563.162862:0:6481:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787096563.162881:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b4433f lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dac expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.162891:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b44346 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dac expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.162896:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9c9c41b55900) 00010000:00010000:2.0:1787096563.162903:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787096563.162905:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4b000, rc 0) 00000100:00100000:2.0:1787096563.162931:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7483a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+22:36552:x1873906352853888:12345-192.168.203.27@tcp:101:rm.0 Request processed in 164us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096563.162936:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 230 00000100:00100000:3.0F:1787096563.164092:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096563.164126:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352854144 00000100:00100000:2.0:1787096563.164130:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352854144 00000100:00100000:2.0:1787096563.164154:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 231 00000100:00100000:2.0:1787096563.164159:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+22:36552:x1873906352854144:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:2.0:1787096563.164166:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096563.164173:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b4434d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6db3 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096563.164237:0:6480:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x13:0x0]: returning size 4096 00010000:00010000:2.0:1787096563.164320:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b4434d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6db3 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.164331:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:2.0:1787096563.164334:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787096563.164338:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b4434d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6db3 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.164348:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4ba00, rc 0) 00000100:00100000:2.0:1787096563.164375:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+23:36552:x1873906352854144:12345-192.168.203.27@tcp:101:rm.0 Request processed in 216us (285us total) trans 4294967378 rc 301/301 00000100:00100000:2.0:1787096563.164379:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 231 00000100:00100000:1.0F:1787096563.166091:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096563.166132:0:13479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352854272 00000100:00100000:2.0:1787096563.166142:0:13479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352854272 00000100:00100000:2.0:1787096563.166180:0:13479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00100000:2.0:1787096563.166191:0:13479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6b329450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+23:36552:x1873906352854272:12345-192.168.203.27@tcp:37:rm.0 00000100:00100000:2.0:1787096563.167872:0:13479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6b329450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+23:36552:x1873906352854272:12345-192.168.203.27@tcp:37:rm.0 Request processed in 1684us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096563.167878:0:13479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 42 00000100:00100000:0.0:1787096563.169837:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096563.169870:0:6483:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352854400 00000100:00100000:3.0:1787096563.169876:0:6483:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352854400 00000100:00080000:0.0:1787096563.169904:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1787096563.169915:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:3.0:1787096563.169922:0:6483:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:36552:x1873906352854400:12345-192.168.203.27@tcp:37:rm.0 00000100:00100000:3.0:1787096563.171447:0:6483:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:36552:x1873906352854400:12345-192.168.203.27@tcp:37:rm.0 Request processed in 1525us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096563.171454:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 43 00000100:00100000:0.0:1787096563.173146:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096563.173173:0:13479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352854656 00000100:00100000:2.0:1787096563.173178:0:13479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352854656 00000100:00100000:2.0:1787096563.173208:0:13479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:2.0:1787096563.173215:0:13479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7483b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+23:36552:x1873906352854656:12345-192.168.203.27@tcp:35:rm.0 00000100:00100000:2.0:1787096563.173344:0:13479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7483b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+24:36552:x1873906352854656:12345-192.168.203.27@tcp:35:rm.0 Request processed in 130us (200us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787096563.173349:0:13479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 44 00000100:00100000:0.0:1787096563.174384:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096563.174598:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352854912 00000100:00100000:3.0:1787096563.174605:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352854912 00000100:00100000:3.0:1787096563.174644:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 232 00000100:00100000:3.0:1787096563.174653:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d74839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+24:36552:x1873906352854912:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:3.0:1787096563.174668:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096563.174684:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b4435b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6dba expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.174796:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44362 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.174811:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44362 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.174824:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44362 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096563.174836:0:6479:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x13:0x0]: returning size 4096 00010000:00010000:3.0:1787096563.174894:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b4435b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dba expref: 27 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.174909:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44362 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x13:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dba expref: 26 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.174925:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9c9c41b55300) 00010000:00010000:3.0:1787096563.174929:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787096563.174932:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2600, rc 0) 00000100:00100000:3.0:1787096563.174968:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d74839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+26:36552:x1873906352854912:12345-192.168.203.27@tcp:101:rm.0 Request processed in 317us (585us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1787096563.174975:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 232 00000100:00100000:0.0:1787096563.176274:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096563.176322:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352855040 00000100:00100000:2.0:1787096563.176327:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352855040 00000100:00100000:2.0:1787096563.176373:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 233 00000100:00100000:2.0:1787096563.176383:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+26:36552:x1873906352855040:12345-192.168.203.27@tcp:41:rm.0 00000004:00000024:2.0:1787096563.176463:0:18819:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1787096563.176502:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+26:36552:x1873906352855040:12345-192.168.203.27@tcp:41:rm.0 Request processed in 122us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096563.176510:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 233 00000100:00100000:0.0:1787096563.177284:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096563.177314:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352855168 00000100:00100000:3.0:1787096563.177320:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352855168 00000100:00100000:3.0:1787096563.177353:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 234 00000100:00100000:3.0:1787096563.177360:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+26:36552:x1873906352855168:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:3.0:1787096563.177368:0:9995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096563.177378:0:9995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44370 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6dc1 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177452:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b44377 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177464:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b44377 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177473:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b44377 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177482:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b4437e lrc: 3/1,0 mode: --/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177487:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b4437e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177499:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b4437e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177547:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44385 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177552:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177557:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096563.177575:0:9995:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x14:0x0]: returning size 0 00000004:00200000:3.0:1787096563.177577:0:9995:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787096563.177586:0:9995:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177592:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44385 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177599:0:9995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b44377 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177603:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b44377 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177607:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b44377 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177610:0:9995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b44377 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177621:0:9995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3600 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096563.177624:0:9995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b44377 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177629:0:9995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b44377 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177636:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9c9c41b55900) 00010000:00010000:3.0:1787096563.177638:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096563.177641:0:9995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b44377 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177645:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b44377 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177652:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b4437e lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177655:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b4437e lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177659:0:9995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b4437e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177662:0:9995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2e00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096563.177664:0:9995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b4437e lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177667:0:9995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b4437e lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177678:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd1c96a2f (ffff9c9d6b340a00) 00010000:00010000:3.0:1787096563.177680:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096563.177681:0:9995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b4437e lrc: 2/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177685:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b4437e lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177699:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44370 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dc1 expref: 28 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177706:0:9995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44385 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dc1 expref: 27 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.177710:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9c9d6b3f0e00) 00010000:00010000:3.0:1787096563.177712:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787096563.177713:0:9995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac3c00, rc 0) 00000100:00100000:3.0:1787096563.177738:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+27:36552:x1873906352855168:12345-192.168.203.27@tcp:101:rm.0 Request processed in 379us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096563.177743:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 234 00000100:00100000:0.0:1787096563.178617:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096563.178644:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352855424 00000100:00100000:2.0:1787096563.178648:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352855424 00000100:00100000:2.0:1787096563.178671:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 235 00000100:00100000:2.0:1787096563.178677:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+27:36552:x1873906352855424:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:2.0:1787096563.178697:0:7414:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1787096563.178711:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44385 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dc1 expref: 27 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178720:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9c9d6b3f0e00) 00010000:00010000:2.0:1787096563.178728:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b44346 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dac expref: 26 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178733:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9c9c41b55900) 00010000:00010000:2.0:1787096563.178735:0:7414:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096563.178742:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b4438c lrc: 3/0,1 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178747:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b4438c lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178752:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b4438c lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178758:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44393 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178762:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44393 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178766:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44393 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178805:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b4439a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178811:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b4439a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178820:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b4439a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178936:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b443a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178942:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b443a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178947:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b443a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178951:0:7414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b443a1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178954:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b443a1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178958:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b443a1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178973:0:7414:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787096563.178980:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b4439a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178984:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b4439a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.178988:0:8377:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096563.178988:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b4439a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.178994:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4a600 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096563.178995:0:8377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b443a1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.179002:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b4439a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.179011:0:8377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4be00 already unused, calling callback (ffffffffc0dbb6f0) 00010000:00010000:2.0:1787096563.179012:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b4439a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.179014:0:8377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b443a1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.179024:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9c9c41ec9e00) 00010000:00010000:2.0:1787096563.179027:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096563.179029:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b4439a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.179035:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b4439a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x14:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.179048:0:8377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b443a1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.179048:0:7414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b4438c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.179063:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b4438c lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.179068:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b4438c lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.179069:0:8377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x14:0x0].0x0 (ffff9c9c41ec9e00) 00010000:00010000:3.0:1787096563.179073:0:8377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787096563.179077:0:8377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b443a1 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.179078:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b4438c lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.179094:0:8377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b443a1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x14:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.179094:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4ba00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:2.0:1787096563.179096:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b4438c lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.179107:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b4438c lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.179114:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096563.179117:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096563.179119:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096563.179121:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9c9c41b55900) 00010000:00010000:2.0:1787096563.179128:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096563.179130:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b4438c lrc: 3/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.179134:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b4438c lrc: 0/0,0 mode: --/CW res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096563.179141:0:7414:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001e0ea112 reply state 000000003c5a9090 transno 4294967381 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44393 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.179147:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44393 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.179151:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd1c96a2f (ffff9c9d6b340a00) 00010000:00010000:2.0:1787096563.179153:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096563.179154:0:7414:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787096563.179184:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+27:36552:x1873906352855424:12345-192.168.203.27@tcp:36:rm.0 Request processed in 507us (568us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1787096563.179189:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 235 00000100:00100000:0.0:1787096563.180266:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096563.180293:0:6483:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352855680 00000100:00100000:3.0:1787096563.180298:0:6483:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352855680 00000100:00100000:3.0:1787096563.180330:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:3.0:1787096563.180340:0:6483:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+27:36552:x1873906352855680:12345-192.168.203.27@tcp:35:rm.0 00000100:00100000:3.0:1787096563.180481:0:6483:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+28:36552:x1873906352855680:12345-192.168.203.27@tcp:35:rm.0 Request processed in 142us (215us total) trans 4294967382 rc 0/0 00000100:00100000:3.0:1787096563.180490:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 45 00000100:00100000:0.0:1787096563.181231:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096563.181267:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352855936 00000100:00100000:3.0:1787096563.181271:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352855936 00000100:00100000:3.0:1787096563.181297:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 236 00000100:00100000:3.0:1787096563.181302:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d4800e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+28:36552:x1873906352855936:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:3.0:1787096563.181322:0:6481:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1787096563.181333:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44362 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x13:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dba expref: 28 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181350:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44338 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6da5 expref: 27 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181359:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b442c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x13:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d7b expref: 26 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181365:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9c9c41b55300) 00010000:00010000:3.0:1787096563.181370:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b442ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d74 expref: 25 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181375:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:3.0:1787096563.181377:0:6481:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096563.181385:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b443a8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181408:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b443a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181415:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b443a8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181422:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b443af lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5a715935 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181427:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b443af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181434:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b443af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181484:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b443b6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181490:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b443b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181495:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b443b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181504:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b443bd lrc: 3/0,1 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181508:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b443bd lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181512:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b443bd lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181535:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181539:0:6481:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.181544:0:6481:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096563.181558:0:6481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42e0a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6481:1873906360266112:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1787096563.181584:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096563.181628:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360266112 00000100:00100000:3.0:1787096563.181631:0:6481:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42ca4180 going to sleep for 11 seconds 00000100:00100000:2.0:1787096563.181634:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360266112 00000100:00100000:2.0:1787096563.181674:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787096563.181684:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6481:x1873906360266112:12345-0@lo:101:mdt00_002.0 00010000:00010000:2.0:1787096563.181694:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096563.181706:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b443cb lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b443c4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.181726:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b442e4 lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d89 expref: 5 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.181743:0:6485:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b443cb lrc: 4/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b443c4 expref: 6 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.181767:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b442e4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d89 expref: 5 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.181793:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b442e4 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d89 expref: 5 pid: 6480 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096563.181804:0:6485:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97ea00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6485:1873906360266240:192.168.203.27@tcp:104: 00000100:00100000:2.0:1787096563.181849:0:6485:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c41e4bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787096563.182641:0:6485:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97ea00 pname:cluuid:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001_UUID:6485:1873906360266240:192.168.203.27@tcp:104: 00010000:00010000:2.0:1787096563.182654:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b443cb lrc: 3/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b443c4 expref: 6 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.182660:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9c9d48c61000) 00010000:00010000:2.0:1787096563.182662:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096563.182664:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b443cb lrc: 3/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b443c4 expref: 6 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.182669:0:6485:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b443cb lrc: 3/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b443c4 expref: 6 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.182673:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4b600, rc 0) 00000100:00100000:2.0:1787096563.182703:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6481:x1873906360266112:12345-0@lo:101:mdt00_002.0 Request processed in 1023us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096563.182713:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1787096563.182731:0:6481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42e0a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6481:1873906360266112:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1787096563.182753:0:6481:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.182763:0:6481:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 4/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096563.183084:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096563.183119:0:6467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352856064 00000100:00100000:2.0:1787096563.183123:0:6467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352856064 00010000:00010000:2.0:1787096563.183143:0:6467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b442e4 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d89 expref: 6 pid: 6480 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096563.183170:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 82 00000100:00100000:2.0:1787096563.183176:0:6467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d500aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:2401:x1873906352856064:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787096563.183183:0:6467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096563.183187:0:6467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b442e4 lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d89 expref: 6 pid: 6480 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.183194:0:6467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b442e4 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d89 expref: 6 pid: 6480 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.183205:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b442e4 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x5:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6d89 expref: 6 pid: 6480 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.183213:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9c9d48c61000) 00010000:00010000:2.0:1787096563.183216:0:6467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b443cb lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b443c4 expref: 5 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.183222:0:6467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b443cb lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b9fb40e15b443c4 expref: 5 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.183228:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b443cb lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b9fb40e15b443c4 expref: 5 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.183251:0:6467:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b443cb lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b443c4 expref: 5 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096563.183258:0:6467:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6467:1873906360266368:0@lo:105: 00000100:00100000:2.0:1787096563.183275:0:6467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787096563.183299:0:6463:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360266368 00000100:00100000:2.0:1787096563.183301:0:6467:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c41e4bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787096563.183303:0:6463:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360266368 00000100:00100000:3.0:1787096563.183335:0:6463:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787096563.183341:0:6463:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e97c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6467:x1873906360266368:12345-0@lo:105: 00010000:00010000:3.0:1787096563.183348:0:6463:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.183355:0:6463:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.183360:0:6463:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 5/0,1 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.183365:0:6463:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 5/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.183370:0:6463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.183374:0:6463:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 6/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.183412:0:6463:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9c9d6eac3400) 00010000:00010000:2.0:1787096563.183438:0:6481:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.183447:0:6481:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096563.183456:0:6463:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e97c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-mdtlov_UUID+4:6467:x1873906360266368:12345-0@lo:105: Request processed in 112us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096563.183463:0:6463:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787096563.183493:0:6467:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001_UUID:6467:1873906360266368:0@lo:105: 00010000:00010000:3.0:1787096563.183506:0:6467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787096563.183532:0:6467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d500aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:2401:x1873906352856064:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 356us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096563.183537:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 82 00000100:00100000:2.0:1787096563.184086:0:6481:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6481:1873906360266496:0@lo:403:mdt00_002.0 00000100:00100000:2.0:1787096563.184112:0:6481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096563.184128:0:6481:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c41e4bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787096563.184141:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360266496 00000100:00100000:3.0:1787096563.184145:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360266496 00000100:00100000:3.0:1787096563.184174:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1787096563.184183:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6481:x1873906360266496:12345-0@lo:403:mdt00_002.0 00000100:00100000:3.0:1787096563.185661:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e97ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6481:x1873906360266496:12345-0@lo:403:mdt00_002.0 Request processed in 1480us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096563.185666:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1787096563.185702:0:6481:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6481:1873906360266496:0@lo:403:mdt00_002.0 00000040:00080000:0.0:1787096563.186640:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].4, 936 off38944 00000040:00080000:0.0:1787096563.186839:0:6481:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].4, 1016 off39504 00000004:00080000:0.0:1787096563.186847:0:6481:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9c9d70ea06c0 with version 7 00000004:00080000:0.0:1787096563.186954:0:7720:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d4551c600 version 7 rpc_version 7 00000020:00100000:0.0:1787096563.186977:0:7720:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096563.186986:0:7720:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d4800f800 x1873906360266752/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2232/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096563.187004:0:7720:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d4800f800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360266752:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787096563.187058:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096563.187081:0:7720:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d6e8eff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787096563.187098:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360266752 00000100:00100000:0.0:1787096563.187102:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360266752 00000100:00100000:0.0:1787096563.187139:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787096563.187147:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:7720:x1873906360266752:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787096563.187365:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+7:7720:x1873906360266752:12345-0@lo:1000:osp_up1-0.0 Request processed in 219us (308us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1787096563.187379:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787096563.187473:0:7720:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d4800f800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360266752:0@lo:1000:osp_up1-0.0 00000004:00200000:0.0:1787096563.187500:0:6481:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x13:0x0]: returning size 4096 00010000:00010000:0.0:1787096563.187517:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b443bd lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187525:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b443bd lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187533:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b443bd lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187540:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096563.187544:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b443bd lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187552:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b443bd lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187566:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9c9c41b55900) 00010000:00010000:0.0:1787096563.187570:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787096563.187575:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b443bd lrc: 2/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187581:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b443bd lrc: 0/0,0 mode: --/EX res: [0x200000400:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187597:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187606:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187617:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187634:0:6481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1787096563.187642:0:6481:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x5:0x0] 00010000:00010000:0.0:1787096563.187651:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b443b6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187657:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b443b6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187663:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b443b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187668:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096563.187672:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b443b6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187679:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b443b6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187690:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9c9c41b55300) 00010000:00010000:0.0:1787096563.187693:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787096563.187697:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b443b6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187703:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b443b6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x13:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187721:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b443a8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187732:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b443a8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187737:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b443a8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187743:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b443a8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187748:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2400 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:0.0:1787096563.187751:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b443a8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187757:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b443a8 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187767:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:0.0:1787096563.187783:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096563.187787:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b443a8 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187793:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2400/0x1b9fb40e15b443a8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096563.187804:0:6481:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000062a5fa8f reply state 00000000db7c6ebb transno 4294967383 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b443af lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187816:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b443af lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187823:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5a715935 (ffff9c9c41b55d00) 00010000:00010000:0.0:1787096563.187830:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1787096563.187833:0:6481:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787096563.187882:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d4800e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+26:36552:x1873906352855936:12345-192.168.203.27@tcp:36:rm.0 Request processed in 6578us (6651us total) trans 4294967383 rc 0/0 00000100:00100000:0.0:1787096563.187891:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 236 00010000:00010000:0.0:1787096563.187916:0:8376:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096563.187921:0:8376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187929:0:8376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3400 already unused, calling callback (ffffffffc1953ee0) 00010000:00010000:0.0:1787096563.187935:0:8376:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096563.187946:0:8376:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187969:0:8376:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.187975:0:8376:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096563.187996:0:8376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.188004:0:8376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d6eac3400/0x1b9fb40e15b443c4 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b443cb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.188026:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096563.188029:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096563.188032:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096563.188041:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787096563.188058:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fc29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360266880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787096563.188093:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096563.188132:0:8378:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360266880 00000100:00100000:0.0:1787096563.188136:0:8378:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360266880 00000100:00100000:0.0:1787096563.188172:0:8378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787096563.188182:0:8378:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+7:3627:x1873906360266880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096563.188192:0:8378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096563.188207:0:8378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b443cb lrc: 0/0,0 mode: --/EX res: [0x240000401:0x5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b9fb40e15b443c4 expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.188219:0:8378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x5:0x0].0x0 (ffff9c9d48c61000) 00010000:00010000:0.0:1787096563.188232:0:8378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787096563.188260:0:8378:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000-mdtlov_UUID+6:3627:x1873906360266880:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096563.188266:0:8378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787096563.188299:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fc29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360266880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096563.406596:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096563.406612:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787096563.406632:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360267136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096563.406699:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096563.406749:0:16634:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360267136 00000100:00100000:2.0:1787096563.406757:0:16634:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360267136 00000100:00100000:3.0:1787096563.406761:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42fa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360267008:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1787096563.406795:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787096563.406803:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096563.406825:0:16634:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360267008 00000100:00100000:2.0:1787096563.406829:0:16634:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360267008 00000100:00100000:1.0:1787096563.406835:0:8363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787096563.406848:0:8363:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360267136:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787096563.406864:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096563.406869:0:16634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1787096563.406877:0:16634:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360267008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1787096563.406879:0:8363:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1787096563.406886:0:16634:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096563.406926:0:16634:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1873906360267008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096563.406926:0:8363:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360267136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096563.406933:0:8363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787096563.406939:0:16634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787096563.406977:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360267136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787096563.406990:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42fa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360267008:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1787096563.684918:0:23002:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 25a: lfs find with --component-flags parity ========================================================== 19:42:44 (1787096564) 00000100:00100000:0.0:1787096563.774505:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096563.774558:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352856192 00000100:00100000:2.0:1787096563.774588:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352856192 00000100:00100000:2.0:1787096563.774646:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 237 00000100:00100000:2.0:1787096563.774658:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+26:36730:x1873906352856192:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1787096563.774684:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096563.774700:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b443d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6dc8 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.774746:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b443d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.774756:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b443d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.774763:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b443d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096563.774820:0:6480:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1787096563.774823:0:6480:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787096563.774840:0:6480:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b443d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.774857:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b443d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dc8 expref: 28 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.774869:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b443d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dc8 expref: 27 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.774875:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:2.0:1787096563.774877:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787096563.774880:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4a800, rc 0) 00000100:00100000:2.0:1787096563.774928:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+27:36730:x1873906352856192:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 274us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096563.774933:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 237 00000100:00100000:0.0:1787096563.776062:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096563.776097:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352856320 00000100:00100000:3.0:1787096563.776102:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352856320 00000100:00100000:3.0:1787096563.776127:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 238 00000100:00100000:3.0:1787096563.776132:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+27:36730:x1873906352856320:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096563.776140:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096563.776149:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b443e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6dcf expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776174:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b443e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776181:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b443e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776186:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b443e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776198:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b443ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776204:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b443ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776210:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b443ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776240:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b443e7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776246:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b443e7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776262:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b443e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776268:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b443e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776274:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2a00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096563.776278:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b443e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776285:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b443e7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776294:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:3.0:1787096563.776296:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096563.776299:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b443e7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776305:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b443e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776316:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b443ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776321:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b443ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776327:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b443ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776332:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2e00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096563.776341:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b443ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776347:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b443ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776354:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4d858f62 (ffff9c9d6b3f0600) 00010000:00010000:3.0:1787096563.776357:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096563.776360:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b443ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776365:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b443ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776415:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b443e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dcf expref: 28 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776426:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:3.0:1787096563.776429:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096563.776433:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b443e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dcf expref: 28 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.776445:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2600, rc 0) 00000100:00100000:3.0:1787096563.776475:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+27:36730:x1873906352856320:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 342us (414us total) trans 0 rc 301/301 00000100:00100000:3.0:1787096563.776480:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 238 00000100:00100000:0.0:1787096563.778614:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096563.778657:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352856576 00000100:00100000:2.0:1787096563.778663:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352856576 00000100:00100000:2.0:1787096563.778697:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 239 00000100:00100000:2.0:1787096563.778704:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:36730:x1873906352856576:12345-192.168.203.27@tcp:36:lfs.0 00000100:00100000:2.0:1787096563.778810:0:18819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360267264:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787096563.778850:0:18819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096563.778891:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360267264 00000100:00100000:0.0:1787096563.778896:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360267264 00000100:00100000:2.0:1787096563.778914:0:18819:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d48d44780 going to sleep for 11 seconds 00000100:00100000:0.0:1787096563.778936:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1787096563.778944:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:18819:x1873906360267264:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787096563.779008:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e97c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+12:18819:x1873906360267264:12345-0@lo:1000:mdt00_005.0 Request processed in 65us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096563.779019:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1787096563.779038:0:18819:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360267264:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787096563.779081:0:18819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360267392:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787096563.779103:0:18819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096563.779120:0:18819:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d48d44780 going to sleep for 11 seconds 00000100:00100000:0.0:1787096563.779142:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360267392 00000100:00100000:0.0:1787096563.779152:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360267392 00000100:00100000:0.0:1787096563.779181:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787096563.779195:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:18819:x1873906360267392:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787096563.779266:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e97dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+12:18819:x1873906360267392:12345-0@lo:1000:mdt00_005.0 Request processed in 79us (162us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787096563.779273:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787096563.779299:0:18819:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360267392:0@lo:1000:mdt00_005.0 00010000:00010000:2.0:1787096563.779342:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.779351:0:18819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.779360:0:18819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096563.779379:0:18819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360267520:0@lo:101:mdt00_005.0 00000100:00100000:2.0:1787096563.779420:0:18819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096563.779443:0:18819:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d48d44000 going to sleep for 11 seconds 00000100:00100000:3.0:1787096563.779454:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360267520 00000100:00100000:3.0:1787096563.779460:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360267520 00000100:00100000:3.0:1787096563.779496:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1787096563.779504:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+12:18819:x1873906360267520:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1787096563.779531:0:6484:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096563.779543:0:6484:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b443fc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b443f5 expref: -99 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.779566:0:6484:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b443d9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dc8 expref: 26 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.779576:0:6484:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b443fc lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b443f5 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.779598:0:6484:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b443d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dc8 expref: 26 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.779610:0:6484:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b443d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dc8 expref: 26 pid: 6480 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096563.779621:0:6484:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42e09180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6484:1873906360267648:192.168.203.27@tcp:104: 00000100:00100000:3.0:1787096563.779671:0:6484:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42ca4780 going to sleep for 11 seconds 00000100:00100000:3.0:1787096563.780587:0:6484:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42e09180 pname:cluuid:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000_UUID:6484:1873906360267648:192.168.203.27@tcp:104: 00010000:00010000:3.0:1787096563.780603:0:6484:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b443fc lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b443f5 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.780613:0:6484:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:3.0:1787096563.780617:0:6484:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096563.780620:0:6484:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b443fc lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b443f5 expref: 13 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.780640:0:6484:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac3600, rc 0) 00000100:00100000:3.0:1787096563.780674:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e97fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+13:18819:x1873906360267520:12345-0@lo:101:mdt00_005.0 Request processed in 1172us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096563.780683:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1787096563.780698:0:18819:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360267520:0@lo:101:mdt00_005.0 00010000:00010000:2.0:1787096563.780714:0:18819:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.780723:0:18819:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096563.780838:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096563.780875:0:6465:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352856704 00000100:00100000:2.0:1787096563.780881:0:6465:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352856704 00010000:00010000:2.0:1787096563.780901:0:6465:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b443d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dc8 expref: 27 pid: 6480 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096563.780924:0:6465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 83 00000100:00100000:2.0:1787096563.780931:0:6465:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+27:2402:x1873906352856704:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787096563.780941:0:6465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096563.780947:0:6465:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b443d9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dc8 expref: 27 pid: 6480 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.780959:0:6465:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b443d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dc8 expref: 27 pid: 6480 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.780976:0:6465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b443d9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dc8 expref: 27 pid: 6480 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.780989:0:6465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:2.0:1787096563.780994:0:6465:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b443fc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b443f5 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.781014:0:6465:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b443fc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b9fb40e15b443f5 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.781022:0:6465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b443fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1b9fb40e15b443f5 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.781039:0:6465:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b443fc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b443f5 expref: 12 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096563.781047:0:6465:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6465:1873906360267776:0@lo:105: 00000100:00100000:2.0:1787096563.781066:0:6465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096563.781086:0:6465:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d48d44000 going to sleep for 11 seconds 00000100:00100000:0.0:1787096563.781103:0:7402:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360267776 00000100:00100000:0.0:1787096563.781108:0:7402:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360267776 00000100:00100000:0.0:1787096563.781139:0:7402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787096563.781144:0:7402:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e97c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6465:x1873906360267776:12345-0@lo:105: 00010000:00010000:0.0:1787096563.781152:0:7402:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.781159:0:7402:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.781165:0:7402:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.781169:0:7402:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.781174:0:7402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.781178:0:7402:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.781198:0:7402:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9c9d7ca4b000) 00010000:00010000:2.0:1787096563.781218:0:18819:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.781228:0:18819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096563.781228:0:7402:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e97c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6465:x1873906360267776:12345-0@lo:105: Request processed in 84us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096563.781238:0:7402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000004:00080000:2.0:1787096563.781256:0:18819:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:1.0:1787096563.781278:0:6465:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:6465:1873906360267776:0@lo:105: 00010000:00010000:2.0:1787096563.781280:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a600/0x1b9fb40e15b44403 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.781287:0:18819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a600/0x1b9fb40e15b44403 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.781292:0:6465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096563.781293:0:18819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a600/0x1b9fb40e15b44403 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096563.781304:0:18819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360267904:0@lo:101:mdt00_005.0 00000100:00100000:1.0:1787096563.781327:0:6465:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+26:2402:x1873906352856704:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 396us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096563.781334:0:18819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096563.781338:0:6465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 83 00000100:00100000:2.0:1787096563.781363:0:18819:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d48d44780 going to sleep for 11 seconds 00000100:00100000:3.0:1787096563.781386:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360267904 00000100:00100000:3.0:1787096563.781411:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360267904 00000100:00100000:3.0:1787096563.781439:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1787096563.781446:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+13:18819:x1873906360267904:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1787096563.781456:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096563.781468:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4440a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b44403 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.781481:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4440a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b44403 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.781489:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4440a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b44403 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.781494:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4d858f62 (ffff9c9d6b3f0c00) 00010000:00010000:3.0:1787096563.781496:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096563.781497:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac3800, rc 0) 00000100:00100000:3.0:1787096563.781575:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e97df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:18819:x1873906360267904:12345-0@lo:101:mdt00_005.0 Request processed in 129us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096563.781581:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787096563.781634:0:18819:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360267904:0@lo:101:mdt00_005.0 00010000:00010000:2.0:1787096563.781644:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a600/0x1b9fb40e15b44403 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b4440a expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.781653:0:18819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a600/0x1b9fb40e15b44403 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b4440a expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787096563.781665:0:18819:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:2.0:1787096563.781688:0:18819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360268032:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787096563.781711:0:18819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096563.781731:0:18819:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d48d44600 going to sleep for 11 seconds 00000100:00100000:0.0:1787096563.781752:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360268032 00000100:00100000:0.0:1787096563.781756:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360268032 00000100:00100000:0.0:1787096563.781786:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1787096563.781791:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:18819:x1873906360268032:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787096563.781835:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e97d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:18819:x1873906360268032:12345-0@lo:1000:mdt00_005.0 Request processed in 45us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096563.781841:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787096563.781855:0:18819:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360268032:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787096563.781888:0:18819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360268160:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787096563.781910:0:18819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096563.781926:0:18819:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d48d44600 going to sleep for 11 seconds 00000100:00100000:1.0:1787096563.781955:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360268160 00000100:00100000:1.0:1787096563.781960:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360268160 00000100:00100000:1.0:1787096563.781988:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1787096563.781995:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:18819:x1873906360268160:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787096563.782065:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e97d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:18819:x1873906360268160:12345-0@lo:1000:mdt00_005.0 Request processed in 70us (153us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787096563.782073:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787096563.782076:0:18819:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360268160:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787096563.782127:0:18819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360268288:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787096563.782142:0:18819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096563.782154:0:18819:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d48d44600 going to sleep for 11 seconds 00000100:00100000:3.0:1787096563.782168:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360268288 00000100:00100000:3.0:1787096563.782172:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360268288 00000100:00100000:3.0:1787096563.782200:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1787096563.782204:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:18819:x1873906360268288:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787096563.782259:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e97d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:18819:x1873906360268288:12345-0@lo:1000:mdt00_005.0 Request processed in 54us (114us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787096563.782268:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787096563.782277:0:18819:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360268288:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787096563.782321:0:18819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360268416:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787096563.782337:0:18819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096563.782347:0:18819:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d48d44600 going to sleep for 11 seconds 00000100:00100000:3.0:1787096563.782357:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360268416 00000100:00100000:3.0:1787096563.782362:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360268416 00000100:00100000:3.0:1787096563.782389:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787096563.782424:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:18819:x1873906360268416:12345-0@lo:1000:mdt00_005.0 00000100:00100000:3.0:1787096563.782476:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e97f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+14:18819:x1873906360268416:12345-0@lo:1000:mdt00_005.0 Request processed in 54us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096563.782483:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1787096563.782489:0:18819:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360268416:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787096563.782524:0:18819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360268544:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787096563.782546:0:18819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096563.782563:0:18819:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d48d44600 going to sleep for 11 seconds 00000100:00100000:0.0:1787096563.782591:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360268544 00000100:00100000:0.0:1787096563.782596:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360268544 00000100:00100000:0.0:1787096563.782622:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1787096563.782630:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:18819:x1873906360268544:12345-0@lo:1000:mdt00_005.0 00000100:00100000:0.0:1787096563.782678:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e97f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+14:18819:x1873906360268544:12345-0@lo:1000:mdt00_005.0 Request processed in 50us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096563.782684:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1787096563.782699:0:18819:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360268544:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787096563.782733:0:18819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360268672:0@lo:1000:mdt00_005.0 00000100:00100000:2.0:1787096563.782751:0:18819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096563.782764:0:18819:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d48d44600 going to sleep for 11 seconds 00000100:00100000:1.0:1787096563.782791:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360268672 00000100:00100000:1.0:1787096563.782796:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360268672 00000100:00100000:1.0:1787096563.782822:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787096563.782838:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:18819:x1873906360268672:12345-0@lo:1000:mdt00_005.0 00000100:00100000:1.0:1787096563.782885:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e97ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0001-mdtlov_UUID+14:18819:x1873906360268672:12345-0@lo:1000:mdt00_005.0 Request processed in 57us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096563.782898:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1787096563.782899:0:18819:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360268672:0@lo:1000:mdt00_005.0 00000040:00080000:2.0:1787096563.783429:0:18819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000400:0x3:0x0].7, 2152 off44184 00000040:00080000:2.0:1787096563.783499:0:18819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000401:0x3:0x0].7, 2352 off45224 00000004:00080000:2.0:1787096563.783504:0:18819:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c9d48d44780 with version 15 00000004:00080000:0.0:1787096563.783543:0:7407:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d589526c0 version 15 rpc_version 15 00000020:00100000:0.0:1787096563.783582:0:7407:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096563.783590:0:7407:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d7fc2b100 x1873906360268928/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 264/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096563.783605:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fc2b100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360268928:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1787096563.783634:0:7407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096563.783650:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d58952240 going to sleep for 11 seconds 00000100:00100000:3.0:1787096563.783662:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360268928 00000100:00100000:3.0:1787096563.783666:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360268928 00000100:00100000:3.0:1787096563.783694:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787096563.783701:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+14:7407:x1873906360268928:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096563.784197:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+15:7407:x1873906360268928:12345-0@lo:1000:osp_up0-1.0 Request processed in 495us (560us total) trans 4294967384 rc 0/0 00000100:00100000:3.0:1787096563.784205:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1787096563.784257:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fc2b100 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360268928:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1787096563.784336:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b44411 lrc: 3/0,1 mode: --/PW res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.784350:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b44411 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.784363:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b44411 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.784380:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b44418 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.784385:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b44418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.784389:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b44418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.784456:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a200/0x1b9fb40e15b4441f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.784461:0:18819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a200/0x1b9fb40e15b4441f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.784467:0:18819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a200/0x1b9fb40e15b4441f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096563.784476:0:18819:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360269056:0@lo:101:mdt00_005.0 00000100:00100000:2.0:1787096563.784502:0:18819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096563.784519:0:18819:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d4568d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787096563.784526:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360269056 00000100:00100000:3.0:1787096563.784532:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360269056 00000100:00100000:3.0:1787096563.784558:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787096563.784563:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+15:18819:x1873906360269056:12345-0@lo:101:mdt00_005.0 00010000:00010000:3.0:1787096563.784573:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096563.784589:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b44426 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b4441f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.784619:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b44426 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b4441f expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.784631:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b44426 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b4441f expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.784640:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9d6b3f0400) 00010000:00010000:3.0:1787096563.784643:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096563.784647:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2c00, rc 0) 00000100:00100000:3.0:1787096563.784678:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e97f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+16:18819:x1873906360269056:12345-0@lo:101:mdt00_005.0 Request processed in 115us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096563.784682:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1787096563.784711:0:18819:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-mdtlov_UUID:18819:1873906360269056:0@lo:101:mdt00_005.0 00010000:00010000:2.0:1787096563.784720:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a200/0x1b9fb40e15b4441f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44426 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.784727:0:18819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a200/0x1b9fb40e15b4441f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b44426 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096563.784738:0:18819:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007a49091c reply state 00000000ed68e3f1 transno 4294967335 ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b44418 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.784746:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b44418 lrc: 3/0,1 mode: TXN/TXN res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.784750:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x7:0x0].0x0 (ffff9c9c41ec9600) 00010000:00010000:2.0:1787096563.784751:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096563.784754:0:18819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787096563.784757:0:18819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a200/0x1b9fb40e15b4441f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44426 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.784778:0:18819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a200/0x1b9fb40e15b4441f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44426 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787096563.784785:0:18819:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000401:0x7:0x0] 00000004:00010000:2.0:1787096563.784789:0:18819:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007a49091c reply state 00000000ed68e3f1 transno 4294967335 ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b44411 lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.784794:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b44411 lrc: 3/0,1 mode: TXN/TXN res: [0x240000402:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.784799:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff9c9c41ec9900) 00010000:00010000:2.0:1787096563.784800:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096563.784801:0:18819:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:2.0:1787096563.784805:0:18819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x8:0x0]: returning size 4096 00000004:00080000:2.0:1787096563.784810:0:18819:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787096563.784815:0:18819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.784821:0:18819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.784827:0:18819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.784845:0:18819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787096563.784849:0:18819:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:2.0:1787096563.784853:0:18819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a600/0x1b9fb40e15b44403 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b4440a expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.784864:0:7403:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096563.784871:0:18819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a600/0x1b9fb40e15b44403 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b4440a expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.784871:0:7403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.784889:0:7403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4b000 already unused, calling callback (ffffffffc1953ee0) 00010000:00010000:0.0:1787096563.784895:0:7403:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096563.784903:0:7403:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.784927:0:7403:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.784932:0:7403:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787096563.784936:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:36730:x1873906352856576:12345-192.168.203.27@tcp:36:lfs.0 Request processed in 6232us (6331us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1787096563.784942:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 239 00010000:00010000:0.0:1787096563.784952:0:7403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.784958:0:7403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4b000/0x1b9fb40e15b443f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b443fc expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096563.784968:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360269184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096563.784968:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096563.784972:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096563.784974:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096563.784995:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096563.785025:0:9435:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360269184 00000100:00100000:2.0:1787096563.785029:0:9435:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360269184 00000100:00100000:2.0:1787096563.785062:0:9435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787096563.785070:0:9435:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+16:3626:x1873906360269184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787096563.785078:0:9435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096563.785090:0:9435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b443fc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b9fb40e15b443f5 expref: 16 pid: 6484 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.785100:0:9435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:2.0:1787096563.785103:0:9435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787096563.785137:0:9435:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+15:3626:x1873906360269184:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096563.785142:0:9435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787096563.785147:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fc2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3626:1873906360269184:0@lo:103:ldlm_bl.0 00000001:00080000:0.0:1787096563.785569:0:6459:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967384 is committed 00000001:00080000:0.0:1787096563.785587:0:6459:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967383 is committed 00000020:00080000:0.0:1787096563.785607:0:6459:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c9d589520c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787096563.785611:0:6459:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d480b4f00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9d58952240 00010000:00010000:1.0:1787096563.785619:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b44108 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096563.785620:0:6459:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].3 00000020:00080000:0.0:1787096563.785624:0:6459:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d480b4700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9d7b023200 00000020:00080000:0.0:1787096563.785630:0:6459:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].3 00010000:00010000:1.0:1787096563.785635:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b44108 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785643:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b44108 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096563.785645:0:6459:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c9c41e4be40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787096563.785649:0:6459:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d480b4d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c41e4b840 00000020:00080000:0.0:1787096563.785654:0:6459:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].2 00010000:00010000:1.0:1787096563.785656:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7cceba00 already unused, calling callback (ffffffffc19474f0) 00000020:00080000:0.0:1787096563.785657:0:6459:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d480b4600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9d6ea37800 00000020:00080000:0.0:1787096563.785660:0:6459:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].2 00010000:00010000:1.0:1787096563.785661:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b44108 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096563.785662:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000020:00080000:2.0:1787096563.785666:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:1.0:1787096563.785671:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b44108 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096563.785677:0:6459:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c9c42ca4c00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1787096563.785679:0:6459:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9c42b1b900 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c42ca4900 00010000:00010000:1.0:1787096563.785680:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2e9bf99 (ffff9c9d820d2100) 00000020:00080000:0.0:1787096563.785681:0:6459:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].1 00010000:00010000:1.0:1787096563.785685:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:0.0:1787096563.785686:0:6459:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9c42b1b700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c42b33400 00010000:00010000:1.0:1787096563.785688:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b44108 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096563.785690:0:6459:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].1 00010000:00010000:1.0:1787096563.785696:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceba00/0x1b9fb40e15b44108 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096563.785704:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 0 00010000:00010000:1.0:1787096563.785706:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b4410f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785711:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b4410f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785722:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b4410f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785726:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7cceb800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096563.785728:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b4410f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785731:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b4410f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785737:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x12:0x0].0x0 (ffff9c9d6b35ce00) 00010000:00010000:1.0:1787096563.785739:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096563.785741:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b4410f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785744:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b4410f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785757:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b44116 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785761:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b44116 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785764:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b44116 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785779:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ccea800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096563.785781:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b44116 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096563.785791:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:1.0:1787096563.785795:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b44116 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785805:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x2:0x0].0x0 (ffff9c9d6b35c400) 00010000:00010000:1.0:1787096563.785807:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096563.785810:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b44116 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785816:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b44116 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785836:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b44235 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785840:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b44235 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785843:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b44235 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785846:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4b800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096563.785848:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b44235 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785851:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b44235 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785855:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2e9bf99 (ffff9c9d820d2100) 00010000:00010000:1.0:1787096563.785857:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096563.785858:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b44235 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785868:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b44235 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x2e9bf99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785878:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b44282 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785881:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b44282 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785886:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b44282 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785891:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4bc00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096563.785893:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b44282 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785899:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b44282 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785906:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5a715935 (ffff9c9c41b55d00) 00010000:00010000:1.0:1787096563.785908:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096563.785911:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b44282 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785916:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b44282 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785926:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44289 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785931:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44289 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785940:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44289 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785945:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4a400 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096563.785948:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44289 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785953:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44289 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785960:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x13:0x0].0x0 (ffff9c9c41b55300) 00010000:00010000:1.0:1787096563.785963:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096563.785965:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44289 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785971:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44289 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785983:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b44290 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785988:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b44290 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785992:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b44290 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.785995:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4ae00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096563.785996:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b44290 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786013:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b44290 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786021:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0x0 (ffff9c9c41b55900) 00010000:00010000:1.0:1787096563.786023:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096563.786026:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b44290 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786031:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b44290 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786045:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b4430e lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786050:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b4430e lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786055:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b4430e lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786060:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4b200 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096563.786063:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b4430e lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786068:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b4430e lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786075:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd1c96a2f (ffff9c9d6b340a00) 00010000:00010000:1.0:1787096563.786077:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096563.786079:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b4430e lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786090:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b4430e lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786101:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44393 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786107:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44393 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786112:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44393 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786117:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4aa00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096563.786119:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44393 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786124:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44393 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786132:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x5:0x0].0xd1c96a2f (ffff9c9d6b340a00) 00010000:00010000:1.0:1787096563.786134:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096563.786137:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44393 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786142:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44393 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x5:0x0].0xd1c96a2f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786154:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b443af lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786159:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b443af lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786171:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b443af lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786176:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3200 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096563.786179:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b443af lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786184:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b443af lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786191:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5a715935 (ffff9c9c41b55d00) 00010000:00010000:1.0:1787096563.786193:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096563.786196:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b443af lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.786201:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b443af lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5a715935 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096563.795810:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096563.795866:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352856832 00000100:00100000:3.0:1787096563.795876:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352856832 00000100:00100000:3.0:1787096563.795933:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 240 00000100:00100000:3.0:1787096563.795944:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+5:36733:x1873906352856832:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096563.795967:0:9995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096563.795985:0:9995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b4442d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6dd6 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.796045:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b44434 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.796076:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b44434 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.796088:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b44434 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096563.796128:0:9995:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787096563.796133:0:9995:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787096563.796150:0:9995:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b44434 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.796175:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b4442d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dd6 expref: 7 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.796193:0:9995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2e00/0x1b9fb40e15b44434 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6dd6 expref: 6 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.796202:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:3.0:1787096563.796205:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787096563.796209:0:9995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2e00, rc 0) 00000100:00100000:3.0:1787096563.796263:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:36733:x1873906352856832:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 321us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096563.796270:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 240 00000100:00100000:1.0:1787096563.797213:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096563.797259:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352856960 00000100:00100000:2.0:1787096563.797265:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352856960 00000100:00100000:2.0:1787096563.797298:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 241 00000100:00100000:2.0:1787096563.797310:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:36733:x1873906352856960:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1787096563.797318:0:7414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096563.797324:0:7414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b4443b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6ddd expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.797349:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44442 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.797355:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44442 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.797361:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44442 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.797375:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b44449 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.797385:0:7414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4440a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b44403 expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.797414:0:7414:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b44449 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.797441:0:7414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4440a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x1b9fb40e15b44403 expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096563.797452:0:7414:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7414:1873906360269312:0@lo:104: 00000100:00100000:2.0:1787096563.797479:0:7414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096563.797521:0:6464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360269312 00000100:00100000:1.0:1787096563.797526:0:6464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360269312 00000100:00100000:2.0:1787096563.797529:0:7414:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d4568d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787096563.797559:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787096563.797565:0:6464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e97e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:7414:x1873906360269312:12345-0@lo:104: 00010000:00010000:1.0:1787096563.797577:0:6464:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a600/0x1b9fb40e15b44403 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b9fb40e15b4440a expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.797630:0:6464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787096563.797636:0:6464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e97e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:7414:x1873906360269312:12345-0@lo:104: Request processed in 71us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096563.797653:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:0.0:1787096563.797657:0:6468:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787096563.797661:0:7414:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d6e97e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7414:1873906360269312:0@lo:104: 00010000:00010000:0.0:1787096563.797665:0:6468:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a600/0x1b9fb40e15b44403 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b9fb40e15b4440a expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.797679:0:6468:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4a600 already unused, calling callback (ffffffffc1953ee0) 00010000:00010000:0.0:1787096563.797684:0:6468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a600/0x1b9fb40e15b44403 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x1b9fb40e15b4440a expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.797691:0:7414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b44449 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096563.797694:0:6468:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a600/0x1b9fb40e15b44403 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x1b9fb40e15b4440a expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.797722:0:6468:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a600/0x1b9fb40e15b44403 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b4440a expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.797734:0:6468:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096563.797758:0:6468:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a600/0x1b9fb40e15b44403 lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b4440a expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.797775:0:6468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a600/0x1b9fb40e15b44403 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b4440a expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096563.797781:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360269440:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096563.797794:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096563.797797:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096563.797800:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096563.797808:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096563.797836:0:8378:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360269440 00000100:00100000:0.0:1787096563.797841:0:8378:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360269440 00010000:00010000:0.0:1787096563.797859:0:8378:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4440a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x1b9fb40e15b44403 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096563.797887:0:8378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787096563.797895:0:8378:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6e97e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+8:3627:x1873906360269440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096563.797903:0:8378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:1.0:1787096563.799050:0:6459:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1787096563.799090:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1787096563.799122:0:8378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4440a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x1b9fb40e15b44403 expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.799137:0:8378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4d858f62 (ffff9c9d6b3f0c00) 00010000:00010000:0.0:1787096563.799141:0:8378:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b44449 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787096563.799142:0:6511:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9c9d4568d000 with version 8 00010000:00010000:0.0:1787096563.799152:0:8378:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b44449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096563.799160:0:6511:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 1 cancel update log [0x240000401:0x3:0x0].1: rc = 0 00010000:00010000:0.0:1787096563.799170:0:8378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b44449 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787096563.799184:0:7720:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d4551c600 version 8 rpc_version 8 00010000:00010000:0.0:1787096563.799192:0:8378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00100000:3.0:1787096563.799208:0:7720:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000020:00080000:2.0:1787096563.799212:0:6511:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 1 cancel update log [0x200000400:0x3:0x0].1: rc = 0 00010000:00010000:1.0:1787096563.799213:0:7414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b44449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096563.799218:0:7720:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9c42e08380 x1873906360269696/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1787096563.799229:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b44449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096563.799231:0:8378:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6e97e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0001-mdtlov_UUID+7:3627:x1873906360269440:12345-0@lo:103:ldlm_bl.0 Request processed in 1335us (1420us total) trans 0 rc 0/0 00000004:00080000:2.0:1787096563.799237:0:6511:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9c9d42e1d780 with version 9 00000020:00080000:2.0:1787096563.799242:0:6511:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 2 cancel update log [0x240000401:0x3:0x0].2: rc = 0 00000100:00100000:0.0:1787096563.799250:0:8378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787096563.799256:0:7720:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42e08380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360269696:0@lo:1000:osp_up1-0.0 00000020:00080000:2.0:1787096563.799262:0:6511:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 2 cancel update log [0x200000400:0x3:0x0].2: rc = 0 00000004:00080000:2.0:1787096563.799298:0:6511:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9c9c42d53c00 with version 10 00000100:00100000:3.0:1787096563.799306:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787096563.799308:0:6511:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 3 cancel update log [0x240000401:0x3:0x0].3: rc = 0 00000100:00100000:1.0:1787096563.799310:0:7414:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42fa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7414:1873906360269824:0@lo:1000:mdt00_003.0 00000020:00080000:2.0:1787096563.799330:0:6511:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 3 cancel update log [0x200000400:0x3:0x0].3: rc = 0 00000100:00100000:3.0:1787096563.799334:0:7720:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42ca4780 going to sleep for 11 seconds 00000020:00080000:2.0:1787096563.799338:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1787096563.799338:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360269696 00000100:00100000:0.0:1787096563.799344:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360269696 00000100:00100000:1.0:1787096563.799353:0:7414:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096563.799367:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fc2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3627:1873906360269440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787096563.799373:0:7414:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c41ae8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787096563.799380:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360269824 00000100:00100000:0.0:1787096563.799383:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360269824 00000100:00100000:3.0:1787096563.799386:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787096563.799419:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7720:x1873906360269696:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787096563.799434:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787096563.799442:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7414:x1873906360269824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787096563.799489:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7414:x1873906360269824:12345-0@lo:1000:mdt00_003.0 Request processed in 49us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096563.799494:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787096563.799511:0:7414:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42fa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7414:1873906360269824:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787096563.799549:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b44450 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096563.799550:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7720:x1873906360269696:12345-0@lo:1000:osp_up1-0.0 Request processed in 155us (244us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1787096563.799566:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00010000:00010000:1.0:1787096563.799569:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b44450 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.799578:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b44450 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096563.799579:0:7720:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42e08380 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360269696:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787096563.799593:0:7720:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d4551c600 version 9 rpc_version 9 00000004:00010000:1.0:1787096563.799601:0:7414:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b44450 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00100000:0.0:1787096563.799605:0:7720:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096563.799612:0:7720:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d7fc28000 x1873906360270080/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1787096563.799614:0:7414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44442 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.799631:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44442 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.799637:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44442 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096563.799638:0:7720:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fc28000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360270080:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1787096563.799647:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44442 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.799651:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4ac00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096563.799654:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44442 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.799659:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44442 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096563.799665:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787096563.799666:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:1.0:1787096563.799669:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096563.799672:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44442 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.799676:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b44442 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.799684:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b44449 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096563.799685:0:7720:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d58952240 going to sleep for 11 seconds 00010000:00010000:1.0:1787096563.799691:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b44449 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.799695:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b44449 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.799699:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4a000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096563.799701:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b44449 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096563.799702:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360270080 00000100:00100000:2.0:1787096563.799707:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360270080 00010000:00010000:1.0:1787096563.799714:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b44449 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.799721:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4d858f62 (ffff9c9d6b3f0c00) 00010000:00010000:1.0:1787096563.799722:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096563.799724:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b44449 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.799727:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a000/0x1b9fb40e15b44449 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d858f62 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096563.799734:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1787096563.799742:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7720:x1873906360270080:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1787096563.799761:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a800/0x1b9fb40e15b4443b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ddd expref: 8 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.799785:0:7414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cee00/0x1b9fb40e15b44450 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ddd expref: 7 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.799793:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff9c9d6b3f4f00) 00010000:00010000:1.0:1787096563.799795:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787096563.799800:0:7414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9cee00, rc 0) 00000100:00100000:2.0:1787096563.799837:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:7720:x1873906360270080:12345-0@lo:1000:osp_up1-0.0 Request processed in 96us (171us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1787096563.799842:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:36733:x1873906352856960:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 2529us (2628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096563.799849:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787096563.799856:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 241 00000100:00100000:0.0:1787096563.799871:0:7720:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fc28000 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360270080:0@lo:1000:osp_up1-0.0 00000004:00080000:0.0:1787096563.799881:0:7720:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d4551c600 version 10 rpc_version 10 00000020:00100000:0.0:1787096563.799893:0:7720:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096563.799897:0:7720:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d7fc28e00 x1873906360270336/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096563.799905:0:7720:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fc28e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360270336:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787096563.799927:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096563.799942:0:7720:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d58952240 going to sleep for 11 seconds 00000100:00100000:2.0:1787096563.799962:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360270336 00000100:00100000:2.0:1787096563.799973:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360270336 00000100:00100000:2.0:1787096563.800006:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1787096563.800013:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+8:7720:x1873906360270336:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787096563.800088:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+9:7720:x1873906360270336:12345-0@lo:1000:osp_up1-0.0 Request processed in 76us (160us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1787096563.800097:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1787096563.800107:0:7720:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fc28e00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360270336:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787096563.800896:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096563.800942:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352857088 00000100:00100000:2.0:1787096563.800948:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352857088 00000100:00100000:2.0:1787096563.800981:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 242 00000100:00100000:2.0:1787096563.800988:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:36733:x1873906352857088:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1787096563.800998:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096563.801006:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44457 lrc: 2/0,0 mode: --/CR res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6de4 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.801035:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b4445e lrc: 3/1,0 mode: --/PR res: [0x240000402:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.801042:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b4445e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.801048:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b4445e lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096563.801098:0:6481:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x8:0x0]: returning size 4096 00000004:00200000:2.0:1787096563.801101:0:6481:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787096563.801117:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b44457 lrc: 0/0,0 mode: --/CR res: [0x240000402:0x8:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6de4 expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.801126:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b4445e lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x8:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6de4 expref: 8 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.801135:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x8:0x0].0x0 (ffff9c9c41ec9900) 00010000:00010000:2.0:1787096563.801137:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1787096563.801139:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4be00, rc 0) 00000100:00100000:2.0:1787096563.801162:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:36733:x1873906352857088:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 176us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096563.801166:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 242 00000100:00100000:3.0:1787096563.801824:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096563.801859:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352857216 00000100:00100000:2.0:1787096563.801863:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352857216 00000100:00100000:2.0:1787096563.801891:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 243 00000100:00100000:2.0:1787096563.801896:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:36733:x1873906352857216:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1787096563.801902:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096563.801910:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44465 lrc: 2/0,0 mode: --/CR res: [0x240000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6deb expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.801929:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b4446c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.801935:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b4446c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.801941:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b4446c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096563.801961:0:6480:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000400:0x7:0x0]: returning size 4096 00000004:00200000:2.0:1787096563.801965:0:6480:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:2.0:1787096563.801982:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44465 lrc: 0/0,0 mode: --/CR res: [0x240000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6deb expref: 10 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.802010:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b4446c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6deb expref: 9 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.802015:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000400:0x7:0x0].0x0 (ffff9c9c41ec9600) 00010000:00010000:2.0:1787096563.802016:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787096563.802018:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4b200, rc 0) 00000100:00100000:2.0:1787096563.802040:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:36733:x1873906352857216:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 145us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096563.802044:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 243 00000100:00100000:1.0:1787096563.802674:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096563.802712:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352857344 00000100:00100000:3.0:1787096563.802717:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352857344 00000100:00100000:3.0:1787096563.802751:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 244 00000100:00100000:3.0:1787096563.802761:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:36733:x1873906352857344:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096563.802783:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096563.802794:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44473 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6df2 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.802822:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b4447a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.802833:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b44426 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b4441f expref: 6 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.802842:0:6479:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b4447a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.802865:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b44426 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x1b9fb40e15b4441f expref: 6 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096563.802889:0:6479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42e0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6479:1873906360270464:0@lo:104: 00000100:00100000:3.0:1787096563.802920:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096563.802951:0:8375:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360270464 00000100:00100000:1.0:1787096563.802955:0:8375:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360270464 00000100:00100000:3.0:1787096563.802956:0:6479:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42ca4900 going to sleep for 11 seconds 00000100:00100000:1.0:1787096563.802983:0:8375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787096563.802988:0:8375:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6479:x1873906360270464:12345-0@lo:104: 00010000:00010000:1.0:1787096563.803000:0:8375:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a200/0x1b9fb40e15b4441f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b9fb40e15b44426 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.803039:0:8375:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787096563.803043:0:8375:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0001-mdtlov_UUID+4:6479:x1873906360270464:12345-0@lo:104: Request processed in 55us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096563.803049:0:8375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:0.0:1787096563.803055:0:8377:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096563.803061:0:8377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a200/0x1b9fb40e15b4441f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b9fb40e15b44426 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.803068:0:8377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4a200 already unused, calling callback (ffffffffc1953ee0) 00010000:00010000:0.0:1787096563.803072:0:8377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a200/0x1b9fb40e15b4441f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x1b9fb40e15b44426 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096563.803074:0:6479:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42e0a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6479:1873906360270464:0@lo:104: 00000004:00010000:0.0:1787096563.803082:0:8377:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a200/0x1b9fb40e15b4441f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x1b9fb40e15b44426 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.803093:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b4447a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.803101:0:8377:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a200/0x1b9fb40e15b4441f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b44426 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.803106:0:8377:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096563.803121:0:8377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a200/0x1b9fb40e15b4441f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b44426 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096563.803126:0:8377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9c9d7ca4a200/0x1b9fb40e15b4441f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b44426 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096563.803133:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d7fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360270592:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096563.803151:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096563.803153:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096563.803155:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787096563.803170:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096563.803200:0:7855:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360270592 00000100:00100000:1.0:1787096563.803203:0:7855:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360270592 00010000:00010000:1.0:1787096563.803216:0:7855:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b44426 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x1b9fb40e15b4441f expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096563.803233:0:7855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787096563.803238:0:7855:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+7:3628:x1873906360270592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096563.803245:0:7855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096563.804028:0:7855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2c00/0x1b9fb40e15b44426 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x1b9fb40e15b4441f expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.804039:0:7855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9d6b3f0400) 00010000:00010000:1.0:1787096563.804043:0:7855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b4447a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.804050:0:7855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b4447a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.804056:0:7855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b4447a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096563.804075:0:7855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096563.804106:0:6479:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b4447a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.804115:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b4447a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096563.804122:0:7855:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+6:3628:x1873906360270592:12345-0@lo:103:ldlm_bl.0 Request processed in 881us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096563.804131:0:7855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787096563.804142:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d7fc28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360270592:0@lo:103:ldlm_bl.0 00000004:00200000:3.0:1787096563.804149:0:6479:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 4096 00000004:00200000:3.0:1787096563.804154:0:6479:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:3.0:1787096563.804183:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2a00/0x1b9fb40e15b44473 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6df2 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.804197:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b4447a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6df2 expref: 8 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.804204:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9d6b3f0400) 00010000:00010000:3.0:1787096563.804206:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787096563.804209:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2600, rc 0) 00000100:00100000:3.0:1787096563.804248:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:36733:x1873906352857344:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1485us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096563.804263:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 244 00000100:00100000:0.0:1787096563.805317:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096563.805352:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352857472 00000100:00100000:2.0:1787096563.805357:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352857472 00000100:00100000:2.0:1787096563.805385:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 245 00000100:00100000:2.0:1787096563.805414:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:36733:x1873906352857472:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1787096563.805424:0:18819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096563.805434:0:18819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b44481 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6df9 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805463:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44488 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805469:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44488 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805475:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44488 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805483:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b4448f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805492:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b4448f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805496:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b4448f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805541:0:18819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44488 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805551:0:18819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44488 lrc: 4/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805557:0:18819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44488 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805564:0:18819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44488 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805569:0:18819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4a400 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:2.0:1787096563.805572:0:18819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44488 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805578:0:18819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44488 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805584:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9d6b3f0400) 00010000:00010000:2.0:1787096563.805585:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096563.805588:0:18819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44488 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805592:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b44488 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805604:0:18819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b4448f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805607:0:18819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b4448f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805611:0:18819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b4448f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805614:0:18819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4bc00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:2.0:1787096563.805615:0:18819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b4448f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805618:0:18819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b4448f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805622:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x98f97dfb (ffff9c9c41ec9700) 00010000:00010000:2.0:1787096563.805623:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096563.805625:0:18819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b4448f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805627:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b4448f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805643:0:18819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b44481 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6df9 expref: 9 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805648:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9d6b3f0400) 00010000:00010000:2.0:1787096563.805649:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096563.805655:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b44481 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6df9 expref: 9 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.805660:0:18819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4ae00, rc 0) 00000100:00100000:2.0:1787096563.805685:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:36733:x1873906352857472:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 295us (370us total) trans 0 rc 301/301 00000100:00100000:2.0:1787096563.805689:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 245 00000100:00100000:0.0:1787096563.806587:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096563.806618:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352857728 00000100:00100000:3.0:1787096563.806623:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352857728 00000100:00100000:3.0:1787096563.806654:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 246 00000100:00100000:3.0:1787096563.806662:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d5894dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:36733:x1873906352857728:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096563.806671:0:9995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096563.806673:0:9995:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787096563.806684:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b4447a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6df2 expref: 8 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.806696:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9d6b3f0400) 00010000:00010000:3.0:1787096563.806702:0:9995:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096563.806710:0:9995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44496 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6e00 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.806757:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4449d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.806778:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4449d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.806787:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4449d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.806799:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b444a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.806806:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b444a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.806824:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b444a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.807133:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b444ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.807143:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b444ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.807151:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b444ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096563.807159:0:9995:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x15:0x0]: returning size 0 00010000:00010000:3.0:1787096563.807178:0:9995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4449d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.807185:0:9995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4449d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.807191:0:9995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4449d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.807197:0:9995:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4449d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.807202:0:9995:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096563.807205:0:9995:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4449d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.807210:0:9995:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4449d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.807228:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c9d6b3f0600) 00010000:00010000:3.0:1787096563.807230:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096563.807233:0:9995:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4449d lrc: 3/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.807239:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4449d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096563.807249:0:9995:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000047d3640b reply state 00000000c0af1c48 transno 4294967385 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b444a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.807259:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b444a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.807265:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x98f97dfb (ffff9c9d6b3f0000) 00010000:00010000:3.0:1787096563.807268:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096563.807270:0:9995:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787096563.807289:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44496 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e00 expref: 10 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.807304:0:9995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b444ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e00 expref: 9 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.807311:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9c9d6b3f0200) 00010000:00010000:3.0:1787096563.807314:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787096563.807316:0:9995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac3600, rc 0) 00000100:00100000:3.0:1787096563.807347:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d5894dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:36733:x1873906352857728:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 685us (759us total) trans 4294967385 rc 0/0 00000100:00100000:3.0:1787096563.807355:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 246 00000100:00100000:1.0:1787096563.808375:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096563.808426:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352857984 00000100:00100000:2.0:1787096563.808431:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352857984 00000100:00100000:2.0:1787096563.808469:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 247 00000100:00100000:2.0:1787096563.808478:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:36733:x1873906352857984:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1787096563.808490:0:7414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096563.808498:0:7414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b444b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6e07 expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.808555:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b444c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.808566:0:7414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b444ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e00 expref: 11 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.808574:0:7414:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b444c0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.808600:0:7414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b444ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e00 expref: 11 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.808613:0:7414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b444ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e00 expref: 11 pid: 9995 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096563.808633:0:7414:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7414:1873906360270720:192.168.203.27@tcp:104: 00000100:00100000:2.0:1787096563.808673:0:7414:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42d53180 going to sleep for 11 seconds 00000100:00100000:2.0:1787096563.809358:0:7414:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d70a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7414:1873906360270720:192.168.203.27@tcp:104: 00010000:00010000:2.0:1787096563.809372:0:7414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b444c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096563.809595:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096563.809629:0:6467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352858112 00000100:00100000:3.0:1787096563.809635:0:6467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352858112 00010000:00010000:3.0:1787096563.809690:0:6467:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b444ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e00 expref: 12 pid: 9995 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096563.809717:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 86 00000100:00100000:3.0:1787096563.809724:0:6467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+12:2401:x1873906352858112:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787096563.809734:0:6467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096563.809739:0:6467:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b444ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e00 expref: 12 pid: 9995 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.809750:0:6467:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b444ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e00 expref: 12 pid: 9995 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.809764:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b444ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e00 expref: 12 pid: 9995 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.809789:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9c9d6b3f0200) 00010000:00010000:3.0:1787096563.809794:0:6467:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b444c0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.809802:0:6467:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b444c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.809808:0:6467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b444c0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096563.809828:0:6467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096563.809840:0:7414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b444c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.809847:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b444c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096563.809857:0:7414:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x15:0x0]: returning size 0 00000100:00100000:3.0:1787096563.809858:0:6467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+11:2401:x1873906352858112:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 133us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096563.809873:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 86 00010000:00010000:2.0:1787096563.809958:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b444c0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.809966:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b444c0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.809972:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b444c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.809978:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4b400 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:2.0:1787096563.809981:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b444c0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.809986:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b444c0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.810006:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9c9d6b3f0200) 00010000:00010000:2.0:1787096563.810008:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787096563.810011:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b444c0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.810014:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b444c0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.810033:0:7414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b444b9 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e07 expref: 10 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.810038:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x15:0x0].0x0 (ffff9c9d6b3f0200) 00010000:00010000:2.0:1787096563.810040:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787096563.810042:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b444b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x15:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e07 expref: 10 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096563.810049:0:7414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4aa00, rc 0) 00000100:00100000:2.0:1787096563.810072:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:36733:x1873906352857984:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 1597us (1700us total) trans 0 rc 301/301 00000100:00100000:2.0:1787096563.810076:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 247 00000100:00100000:1.0:1787096563.810888:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096563.810922:0:13479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352858368 00000100:00100000:2.0:1787096563.810926:0:13479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352858368 00000100:00100000:2.0:1787096563.810949:0:13479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 46 00000100:00100000:2.0:1787096563.810954:0:13479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:36733:x1873906352858368:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1787096563.811056:0:13479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:36733:x1873906352858368:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 102us (168us total) trans 4294967386 rc 0/0 00000100:00100000:2.0:1787096563.811061:0:13479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 46 00000001:02000400:3.0:1787096564.253031:0:23050:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_25a: @@@@@@ FAIL: setstripe EC failed 00000100:00100000:0.0:1787096564.354215:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096564.354281:0:6475:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352858496 00000100:00100000:3.0:1787096564.354294:0:6475:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352858496 00000100:00100000:3.0:1787096564.354378:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 331 00000100:00100000:3.0:1787096564.354426:0:6475:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d51326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2402:x1873906352858496:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1787096564.354517:0:6475:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d51326c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2402:x1873906352858496:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 128us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096564.354525:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 331 00010000:00010000:0.0:1787096564.430557:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1315 lines, 1315 kept, 0 dropped, 0 bad.