00000100:00100000:3.0F:1787096566.990863:0:3627:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d57c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360275712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1787096566.990936:0:3627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0F:1787096566.990979:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360275712 00000100:00100000:2.0:1787096566.990992:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360275712 00000100:00100000:2.0:1787096566.991037:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787096566.991046:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360275712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1787096566.991079:0:7723:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446297600 avail 1300058112 00000100:00100000:2.0:1787096566.991125:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+5:3627:x1873906360275712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096566.991133:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1787096566.991155:0:3627:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967344 gen 2 00000004:00080000:3.0:1787096566.991161:0:3627:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967334 committed transno 4294967344 00000020:00080000:3.0:1787096566.991167:0:3627:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c9d6e8efcc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787096566.991171:0:3627:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d6eb08600 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9d70ea06c0 00000020:00080000:3.0:1787096566.991176:0:3627:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].4 00000020:00080000:3.0:1787096566.991178:0:3627:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d6eb08100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c42e69c00 00000020:00080000:3.0:1787096566.991183:0:3627:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].4 00000004:00080000:3.0:1787096566.991209:0:3627:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967336 committed transno 4294967344 00000004:00080000:3.0:1787096566.991221:0:3627:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967337 committed transno 4294967344 00000020:00080000:2.0:1787096566.991229:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000004:00080000:3.0:1787096566.991232:0:3627:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967338 committed transno 4294967344 00000004:00080000:3.0:1787096566.991242:0:3627:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967344 committed transno 4294967344 00000100:00100000:3.0:1787096566.991259:0:3627:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d57c27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3627:1873906360275712:0@lo:41:osp-pre-1-0.0 00000020:00080000:2.0:1787096566.991280:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0F:1787096567.502602:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096567.592691:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0F:1787096567.592759:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352863360 00000100:00100000:1.0:1787096567.592775:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352863360 00000100:00080000:0.0:1787096567.592807:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787096567.592837:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 266 00000100:00100000:1.0:1787096567.592846:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+15:37769:x1873906352863360:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:1.0:1787096567.592865:0:18819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096567.592880:0:18819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce400/0x1b9fb40e15b4465d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6e70 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.592935:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b44664 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.592950:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b44664 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.592962:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b44664 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096567.593049:0:18819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 4096 00000004:00200000:1.0:1787096567.593054:0:18819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:1.0:1787096567.593070:0:18819:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b44664 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.593101:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce400/0x1b9fb40e15b4465d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e70 expref: 17 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.593118:0:18819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b44664 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x16:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e70 expref: 16 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.593131:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9c9c41ec9d00) 00010000:00010000:1.0:1787096567.593135:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787096567.593138:0:18819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9ce600, rc 0) 00000100:00100000:1.0:1787096567.593198:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+16:37769:x1873906352863360:12345-192.168.203.27@tcp:101:rm.0 Request processed in 353us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096567.593204:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 266 00000100:00100000:1.0:1787096567.596478:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096567.596516:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352863488 00000100:00100000:0.0:1787096567.596530:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352863488 00000100:00080000:1.0:1787096567.596582:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1787096567.596602:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 267 00000100:00100000:0.0:1787096567.596614:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+8:37769:x1873906352863488:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:0.0:1787096567.596640:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096567.596660:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b4466b lrc: 2/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6e77 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.596716:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb600/0x1b9fb40e15b44672 lrc: 3/1,0 mode: --/PR res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.596728:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb600/0x1b9fb40e15b44672 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.596736:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb600/0x1b9fb40e15b44672 lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096567.596787:0:6479:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x6:0x0]: returning size 4096 00000004:00200000:0.0:1787096567.596792:0:6479:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:0.0:1787096567.596826:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea000/0x1b9fb40e15b4466b lrc: 0/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e77 expref: 10 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.596838:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb600/0x1b9fb40e15b44672 lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e77 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.596844:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff9c9d6b35c100) 00010000:00010000:0.0:1787096567.596846:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787096567.596849:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7cceb600, rc 0) 00000100:00100000:0.0:1787096567.596895:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:37769:x1873906352863488:12345-192.168.203.27@tcp:101:rm.0 Request processed in 285us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096567.596901:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 267 00000100:00100000:0.0:1787096567.598508:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096567.598762:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352863744 00000100:00100000:1.0:1787096567.598770:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352863744 00000100:00100000:1.0:1787096567.598820:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 268 00000100:00100000:1.0:1787096567.598835:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+16:37769:x1873906352863744:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:1.0:1787096567.598853:0:9995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096567.598869:0:9995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce400/0x1b9fb40e15b44679 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6e7e expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096567.598992:0:9995:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 4096 00010000:00010000:1.0:1787096567.599079:0:9995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce400/0x1b9fb40e15b44679 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e7e expref: 18 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.599094:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:1.0:1787096567.599097:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787096567.599101:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce400/0x1b9fb40e15b44679 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e7e expref: 18 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.599113:0:9995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9ce400, rc 0) 00000100:00100000:1.0:1787096567.599162:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+17:37769:x1873906352863744:12345-192.168.203.27@tcp:101:rm.0 Request processed in 328us (656us total) trans 4294967391 rc 301/301 00000100:00100000:1.0:1787096567.599168:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 268 00000100:00100000:0.0:1787096567.601251:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096567.601311:0:13479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352863872 00000100:00100000:2.0:1787096567.601321:0:13479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352863872 00000100:00100000:2.0:1787096567.601369:0:13479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:2.0:1787096567.601379:0:13479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d6b328050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+17:37769:x1873906352863872:12345-192.168.203.27@tcp:37:rm.0 00000100:00100000:0.0:1787096567.604154:0:13479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d6b328050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+17:37769:x1873906352863872:12345-192.168.203.27@tcp:37:rm.0 Request processed in 2770us (2900us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096567.604168:0:13479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 52 00000100:00100000:0.0:1787096567.607448:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096567.607514:0:6483:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352864000 00000100:00100000:3.0:1787096567.607523:0:6483:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352864000 00000100:00100000:3.0:1787096567.607582:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:3.0:1787096567.607594:0:6483:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:37769:x1873906352864000:12345-192.168.203.27@tcp:37:rm.0 00000100:00100000:3.0:1787096567.609814:0:6483:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:37769:x1873906352864000:12345-192.168.203.27@tcp:37:rm.0 Request processed in 2217us (2366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096567.609824:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 53 00000100:00100000:1.0:1787096567.611499:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096567.611541:0:13479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352864256 00000100:00100000:0.0:1787096567.611549:0:13479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352864256 00000100:00100000:0.0:1787096567.611596:0:13479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 54 00000100:00100000:0.0:1787096567.611608:0:13479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+17:37769:x1873906352864256:12345-192.168.203.27@tcp:35:rm.0 00000100:00100000:0.0:1787096567.611816:0:13479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+18:37769:x1873906352864256:12345-192.168.203.27@tcp:35:rm.0 Request processed in 210us (319us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1787096567.611823:0:13479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 54 00000100:00100000:0.0:1787096567.612902:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096567.612935:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352864512 00000100:00100000:1.0:1787096567.612944:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352864512 00000100:00100000:1.0:1787096567.612977:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 269 00000100:00100000:1.0:1787096567.612983:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+18:37769:x1873906352864512:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:1.0:1787096567.612998:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096567.613014:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce400/0x1b9fb40e15b44687 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6e85 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.613113:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b4468e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.613125:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b4468e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.613133:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b4468e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096567.613149:0:6481:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 4096 00010000:00010000:1.0:1787096567.613207:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce400/0x1b9fb40e15b44687 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e85 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.613221:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b4468e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x16:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e85 expref: 20 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.613228:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9c9c41ec9d00) 00010000:00010000:1.0:1787096567.613230:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787096567.613232:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9cfe00, rc 0) 00000100:00100000:1.0:1787096567.613262:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+20:37769:x1873906352864512:12345-192.168.203.27@tcp:101:rm.0 Request processed in 279us (363us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1787096567.613267:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 269 00000100:00100000:1.0:1787096567.614702:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096567.614755:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352864640 00000100:00100000:2.0:1787096567.614763:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352864640 00000100:00100000:2.0:1787096567.614801:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 270 00000100:00100000:2.0:1787096567.614812:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+20:37769:x1873906352864640:12345-192.168.203.27@tcp:41:rm.0 00000004:00000024:2.0:1787096567.614854:0:6480:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 7847059456 avail 7384014848 00000100:00100000:2.0:1787096567.614903:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+20:37769:x1873906352864640:12345-192.168.203.27@tcp:41:rm.0 Request processed in 94us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096567.614911:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 270 00000100:00100000:1.0:1787096567.616347:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096567.616387:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352864768 00000100:00100000:2.0:1787096567.616695:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352864768 00000100:00100000:2.0:1787096567.616752:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 271 00000100:00100000:2.0:1787096567.616764:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+9:37769:x1873906352864768:12345-192.168.203.27@tcp:101:rm.0 00010000:00010000:2.0:1787096567.616779:0:7414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096567.616803:0:7414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b4469c lrc: 2/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6e8c expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.616859:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b446a3 lrc: 3/1,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.616871:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b446a3 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.616882:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b446a3 lrc: 3/1,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.616894:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b446aa lrc: 3/1,0 mode: --/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.616901:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b446aa lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.616908:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b446aa lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.616970:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b446b1 lrc: 3/1,0 mode: --/PR res: [0x240000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.616978:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b446b1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.616986:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b446b1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096567.617019:0:7414:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000402:0x9:0x0]: returning size 0 00000004:00200000:2.0:1787096567.617023:0:7414:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1787096567.617039:0:7414:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b446b1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617056:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b446b1 lrc: 3/1,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617065:0:7414:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b446a3 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617072:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b446a3 lrc: 4/1,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617079:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b446a3 lrc: 3/0,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617086:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b446a3 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617091:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4a600 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:2.0:1787096567.617095:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b446a3 lrc: 4/0,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617103:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b446a3 lrc: 5/0,0 mode: CR/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617114:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff9c9d6b35c100) 00010000:00010000:2.0:1787096567.617117:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096567.617121:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b446a3 lrc: 3/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617128:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a600/0x1b9fb40e15b446a3 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617138:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b446aa lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617151:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b446aa lrc: 2/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617157:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b446aa lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617162:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4a200 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:2.0:1787096567.617165:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b446aa lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617172:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b446aa lrc: 4/0,0 mode: PR/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617180:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x727485fe (ffff9c9d6b340b00) 00010000:00010000:2.0:1787096567.617183:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096567.617186:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b446aa lrc: 2/0,0 mode: --/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617193:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b446aa lrc: 0/0,0 mode: --/PR res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617217:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4bc00/0x1b9fb40e15b4469c lrc: 0/0,0 mode: --/CR res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e8c expref: 11 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617230:0:7414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b446b1 lrc: 3/0,0 mode: PR/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e8c expref: 10 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.617238:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffff9c9d6b340400) 00010000:00010000:2.0:1787096567.617241:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787096567.617249:0:7414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4b400, rc 0) 00000100:00100000:2.0:1787096567.617292:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:37769:x1873906352864768:12345-192.168.203.27@tcp:101:rm.0 Request processed in 531us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096567.617300:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 271 00000100:00100000:1.0:1787096567.618771:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096567.618810:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352865024 00000100:00100000:3.0:1787096567.618818:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352865024 00000100:00100000:3.0:1787096567.618864:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 272 00000100:00100000:3.0:1787096567.618875:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d7fc2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:37769:x1873906352865024:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:3.0:1787096567.618922:0:18819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787096567.618941:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b446b1 lrc: 0/0,0 mode: --/PR res: [0x240000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e8c expref: 10 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.618962:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffff9c9d6b340400) 00010000:00010000:3.0:1787096567.618978:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb600/0x1b9fb40e15b44672 lrc: 0/0,0 mode: --/PR res: [0x240000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e77 expref: 9 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.618987:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff9c9d6b35c100) 00010000:00010000:3.0:1787096567.618993:0:18819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096567.619018:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b446b8 lrc: 3/0,1 mode: --/CW res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619031:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b446b8 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619039:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b446b8 lrc: 3/0,1 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619051:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b446bf lrc: 3/0,1 mode: --/PW res: [0x240000401:0x6:0x0].0x727485fe bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619058:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b446bf lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619065:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b446bf lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619129:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b446c6 lrc: 3/0,1 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619138:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b446c6 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619155:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b446c6 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619323:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b446cd lrc: 3/0,1 mode: --/PW res: [0x240000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619342:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b446cd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619350:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b446cd lrc: 3/0,1 mode: PW/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619357:0:18819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b446cd lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619364:0:18819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b446cd lrc: 4/0,1 mode: PW/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619370:0:18819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b446cd lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619411:0:18819:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787096567.619427:0:18819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b446c6 lrc: 3/0,1 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619434:0:18819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b446c6 lrc: 2/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619441:0:18819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b446c6 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619447:0:18819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096567.619451:0:8377:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787096567.619459:0:18819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b446c6 lrc: 3/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.619461:0:8377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b446cd lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619473:0:18819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b446c6 lrc: 4/0,0 mode: EX/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.619475:0:8377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3c00 already unused, calling callback (ffffffffc0dbb6f0) 00010000:00010000:1.0:1787096567.619482:0:8377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b446cd lrc: 2/0,0 mode: PW/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619486:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffff9c9d46811b00) 00010000:00010000:3.0:1787096567.619492:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787096567.619496:0:18819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b446c6 lrc: 2/0,0 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.619496:0:8377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b446cd lrc: 3/0,0 mode: PW/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619512:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b446c6 lrc: 0/0,0 mode: --/EX res: [0x240000402:0x9:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.619513:0:8377:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000402:0x9:0x0].0x0 (ffff9c9d46811b00) 00010000:00010000:1.0:1787096567.619519:0:8377:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787096567.619524:0:8377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b446cd lrc: 1/0,0 mode: --/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.619531:0:8377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b446cd lrc: 0/0,0 mode: --/PW res: [0x240000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619534:0:18819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b446b8 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619542:0:18819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b446b8 lrc: 4/0,1 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.619547:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096567.619548:0:18819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b446b8 lrc: 3/0,0 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096567.619551:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787096567.619554:0:8377:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787096567.619557:0:18819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b446b8 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619563:0:18819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3600 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096567.619566:0:18819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b446b8 lrc: 4/0,0 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619572:0:18819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b446b8 lrc: 5/0,0 mode: CW/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619590:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff9c9d46811700) 00010000:00010000:3.0:1787096567.619593:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096567.619596:0:18819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b446b8 lrc: 3/0,0 mode: --/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619602:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b446b8 lrc: 0/0,0 mode: --/CW res: [0x240000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096567.619615:0:18819:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006bc60a1c reply state 00000000ffe382e6 transno 4294967347 ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b446bf lrc: 3/0,1 mode: PW/PW res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619626:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b446bf lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.619633:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x727485fe (ffff9c9d6b340b00) 00010000:00010000:3.0:1787096567.619636:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1787096567.619639:0:18819:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787096567.619694:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d7fc2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:37769:x1873906352865024:12345-192.168.203.27@tcp:36:rm.0 Request processed in 821us (926us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1787096567.619702:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 272 00000100:00100000:1.0:1787096567.621864:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096567.621907:0:6483:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352865280 00000100:00100000:3.0:1787096567.621915:0:6483:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352865280 00000100:00100000:3.0:1787096567.621962:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:3.0:1787096567.621974:0:6483:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+20:37769:x1873906352865280:12345-192.168.203.27@tcp:35:rm.0 00000100:00100000:3.0:1787096567.622144:0:6483:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+21:37769:x1873906352865280:12345-192.168.203.27@tcp:35:rm.0 Request processed in 173us (282us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1787096567.622154:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 55 00000100:00100000:1.0:1787096567.623241:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096567.623284:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352865536 00000100:00100000:0.0:1787096567.623290:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352865536 00000100:00100000:0.0:1787096567.623333:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 273 00000100:00100000:0.0:1787096567.623343:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+21:37769:x1873906352865536:12345-192.168.203.27@tcp:36:rm.0 00010000:00010000:0.0:1787096567.623381:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1787096567.623435:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cfe00/0x1b9fb40e15b4468e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x16:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e85 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.623456:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce600/0x1b9fb40e15b44664 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e70 expref: 20 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.623479:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceae00/0x1b9fb40e15b445f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x16:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e46 expref: 19 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.623491:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9c9c41ec9d00) 00010000:00010000:0.0:1787096567.623500:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b445d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e3f expref: 18 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.623509:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:0.0:1787096567.623513:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787096567.623534:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b446d4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.623546:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b446d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.623556:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b446d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.623566:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b446db lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.623574:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b446db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.623581:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b446db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.623644:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b446e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.623663:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b446e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.623670:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b446e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.623688:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b446e9 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.623696:0:6479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44602 lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e4d expref: 17 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.623703:0:6479:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b446e9 lrc: 4/0,1 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.623734:0:6479:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44602 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e4d expref: 17 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.623758:0:6479:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44602 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e4d expref: 17 pid: 6480 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096567.623773:0:6479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d57c25880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6479:1873906360275840:192.168.203.27@tcp:104: 00000100:00100000:0.0:1787096567.623847:0:6479:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42ce3180 going to sleep for 11 seconds 00000100:00100000:2.0:1787096567.624651:0:6479:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d57c25880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6479:1873906360275840:192.168.203.27@tcp:104: 00010000:00010000:2.0:1787096567.624674:0:6479:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b446e9 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096567.626062:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096567.626110:0:8378:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352865664 00000100:00100000:0.0:1787096567.626118:0:8378:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352865664 00010000:00010000:0.0:1787096567.626147:0:8378:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44602 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e4d expref: 18 pid: 6480 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096567.626187:0:8378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 91 00000100:00100000:0.0:1787096567.626204:0:8378:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+18:2402:x1873906352865664:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787096567.626216:0:8378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787096567.626222:0:8378:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44602 lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e4d expref: 18 pid: 6480 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.626235:0:8378:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44602 lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e4d expref: 18 pid: 6480 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.626253:0:8378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44602 lrc: 0/0,0 mode: --/PR res: [0x200000400:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e4d expref: 18 pid: 6480 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.626268:0:8378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff9c9c41ec9500) 00010000:00010000:0.0:1787096567.626273:0:8378:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b446e9 lrc: 3/0,1 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.626281:0:8378:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b446e9 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.626288:0:8378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b446e9 lrc: 4/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.626314:0:8378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096567.626349:0:6479:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b446e9 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096567.626355:0:8378:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+17:2402:x1873906352865664:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 153us (295us total) trans 0 rc 0/0 00010000:00010000:2.0:1787096567.626361:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b446e9 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096567.626368:0:8378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 91 00010000:00010000:2.0:1787096567.626444:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4bc00/0x1b9fb40e15b446f0 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.626452:0:6479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4bc00/0x1b9fb40e15b446f0 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.626461:0:6479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4bc00/0x1b9fb40e15b446f0 lrc: 3/0,1 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096567.626478:0:6479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d71180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6479:1873906360275968:0@lo:101:mdt00_000.0 00000100:00100000:2.0:1787096567.626522:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096567.626561:0:6479:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42e45c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787096567.626631:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360275968 00000100:00100000:0.0:1787096567.626636:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360275968 00000100:00100000:0.0:1787096567.626671:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787096567.626678:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6479:x1873906360275968:12345-0@lo:101:mdt00_000.0 00010000:00010000:0.0:1787096567.626700:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096567.626714:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb200/0x1b9fb40e15b446f7 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b446f0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.626733:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb200/0x1b9fb40e15b446f7 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b446f0 expref: 6 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.626758:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb200/0x1b9fb40e15b446f7 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b446f0 expref: 6 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096567.626766:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff9c9d6b35c900) 00010000:00010000:0.0:1787096567.626769:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787096567.626772:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7cceb200, rc 0) 00000100:00100000:0.0:1787096567.626812:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6479:x1873906360275968:12345-0@lo:101:mdt00_000.0 Request processed in 133us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096567.626818:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787096567.626852:0:6479:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d71180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6479:1873906360275968:0@lo:101:mdt00_000.0 00010000:00010000:2.0:1787096567.626863:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4bc00/0x1b9fb40e15b446f0 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b446f7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.626880:0:6479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4bc00/0x1b9fb40e15b446f0 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b446f7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096567.627483:0:6479:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d71180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6479:1873906360276096:0@lo:403:mdt00_000.0 00000100:00100000:2.0:1787096567.627522:0:6479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096567.627550:0:6479:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42e45c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787096567.627573:0:7723:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360276096 00000100:00100000:3.0:1787096567.627585:0:7723:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360276096 00000100:00100000:3.0:1787096567.627619:0:7723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787096567.627626:0:7723:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:6479:x1873906360276096:12345-0@lo:403:mdt00_000.0 00000100:00100000:3.0:1787096567.629590:0:7723:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_003:lustre-MDT0000-mdtlov_UUID+6:6479:x1873906360276096:12345-0@lo:403:mdt00_000.0 Request processed in 1959us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096567.629601:0:7723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787096567.629666:0:6479:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d71180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6479:1873906360276096:0@lo:403:mdt00_000.0 00000040:00080000:2.0:1787096567.630622:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].6, 936 off42032 00000040:00080000:2.0:1787096567.630833:0:6479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].6, 1016 off42872 00000004:00080000:2.0:1787096567.630841:0:6479:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9c9c42e45c00 with version 12 00000004:00080000:2.0:1787096567.630859:0:7720:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d4551c600 version 12 rpc_version 12 00000020:00100000:2.0:1787096567.630886:0:7720:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1787096567.630896:0:7720:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9c42d71180 x1873906360276352/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 2232/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787096567.630917:0:7720:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d71180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360276352:0@lo:1000:osp_up1-0.0 00000100:00100000:2.0:1787096567.630965:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096567.630993:0:7720:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42e45b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787096567.632457:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360276352 00000100:00100000:0.0:1787096567.632465:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360276352 00000100:00100000:0.0:1787096567.632505:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787096567.632515:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7720:x1873906360276352:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787096567.632752:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7720:x1873906360276352:12345-0@lo:1000:osp_up1-0.0 Request processed in 229us (1776us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787096567.632761:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787096567.632801:0:7720:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d71180 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360276352:0@lo:1000:osp_up1-0.0 00000004:00200000:2.0:1787096567.633287:0:6479:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x16:0x0]: returning size 4096 00010000:00010000:2.0:1787096567.633306:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b446e9 lrc: 3/0,1 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633313:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b446e9 lrc: 2/0,0 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633318:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b446e9 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633329:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ccea800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:2.0:1787096567.633333:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b446e9 lrc: 3/0,0 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633338:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b446e9 lrc: 4/0,0 mode: EX/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633351:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff9c9c41ec9500) 00010000:00010000:2.0:1787096567.633353:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096567.633357:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b446e9 lrc: 2/0,0 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633361:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea800/0x1b9fb40e15b446e9 lrc: 0/0,0 mode: --/EX res: [0x200000400:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633371:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4bc00/0x1b9fb40e15b446f0 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b446f7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633377:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4bc00/0x1b9fb40e15b446f0 lrc: 4/0,1 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b446f7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633382:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4bc00/0x1b9fb40e15b446f0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1b9fb40e15b446f7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633413:0:6479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1787096567.633420:0:6479:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x6:0x0] 00010000:00010000:2.0:1787096567.633427:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b446e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633433:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b446e2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.633441:0:8376:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787096567.633448:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b446e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.633450:0:8376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4bc00/0x1b9fb40e15b446f0 lrc: 2/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1b9fb40e15b446f7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633463:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7cceb800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096567.633466:0:8376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4bc00 already unused, calling callback (ffffffffc1953ee0) 00010000:00010000:2.0:1787096567.633468:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b446e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.633471:0:8376:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4bc00/0x1b9fb40e15b446f0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1b9fb40e15b446f7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633479:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b446e2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787096567.633482:0:8376:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4bc00/0x1b9fb40e15b446f0 lrc: 3/0,0 mode: EX/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1b9fb40e15b446f7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633496:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9c9c41ec9d00) 00010000:00010000:2.0:1787096567.633499:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787096567.633502:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b446e2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633508:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb800/0x1b9fb40e15b446e2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x16:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.633511:0:8376:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4bc00/0x1b9fb40e15b446f0 lrc: 2/0,0 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b446f7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.633518:0:8376:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787096567.633529:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b446d4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.633535:0:8376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4bc00/0x1b9fb40e15b446f0 lrc: 1/0,0 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b446f7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633537:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b446d4 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.633554:0:8376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4bc00/0x1b9fb40e15b446f0 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1b9fb40e15b446f7 expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633554:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b446d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633565:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b446d4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633574:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7cceaa00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:2.0:1787096567.633582:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b446d4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.633586:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096567.633587:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b446d4 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.633589:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096567.633594:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:2.0:1787096567.633596:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096567.633600:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b446d4 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.633601:0:8376:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787096567.633606:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceaa00/0x1b9fb40e15b446d4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096567.633615:0:6479:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000638f4456 reply state 0000000054ad5c6e transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b446db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633624:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b446db lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096567.633629:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xebbc3de1 (ffff9c9c41ec9c00) 00000100:00100000:3.0:1787096567.633632:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360276480:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787096567.633632:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096567.633635:0:6479:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787096567.633687:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096567.633692:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+18:37769:x1873906352865536:12345-192.168.203.27@tcp:36:rm.0 Request processed in 10350us (10451us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1787096567.633698:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 273 00000100:00100000:3.0:1787096567.633767:0:6467:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360276480 00000100:00100000:3.0:1787096567.633771:0:6467:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360276480 00000100:00100000:3.0:1787096567.633809:0:6467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787096567.633817:0:6467:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+7:3628:x1873906360276480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787096567.633826:0:6467:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787096567.633841:0:6467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7cceb200/0x1b9fb40e15b446f7 lrc: 0/0,0 mode: --/EX res: [0x240000401:0x6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1b9fb40e15b446f0 expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096567.633852:0:6467:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x0 (ffff9c9d6b35c900) 00010000:00010000:3.0:1787096567.633865:0:6467:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787096567.633949:0:6467:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000-mdtlov_UUID+6:3628:x1873906360276480:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096567.633954:0:6467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787096567.633984:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42e08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3628:1873906360276480:0@lo:103:ldlm_bl.0 00000001:02000400:1.0:1787096568.244105:0:23493:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-ec test 26b: EC data integrity with patterned data and 4M stripes ========================================================== 19:42:48 (1787096568) 00000100:00100000:1.0:1787096568.322342:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096568.322428:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352865792 00000100:00100000:0.0:1787096568.322439:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352865792 00000100:00100000:0.0:1787096568.322493:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 274 00000100:00100000:0.0:1787096568.322504:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+18:37939:x1873906352865792:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:0.0:1787096568.322538:0:9995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096568.322555:0:9995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b446fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6e93 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096568.322630:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceac00/0x1b9fb40e15b44705 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096568.322644:0:9995:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceac00/0x1b9fb40e15b44705 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096568.322656:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceac00/0x1b9fb40e15b44705 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787096568.322697:0:9995:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1787096568.322700:0:9995:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1787096568.322717:0:9995:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceac00/0x1b9fb40e15b44705 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096568.322754:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b446fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e93 expref: 20 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096568.322769:0:9995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceac00/0x1b9fb40e15b44705 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e93 expref: 19 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096568.322778:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:0.0:1787096568.322781:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787096568.322785:0:9995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7cceac00, rc 0) 00000100:00100000:0.0:1787096568.322846:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+19:37939:x1873906352865792:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 343us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096568.322853:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 274 00000100:00100000:2.0:1787096568.325505:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096568.325801:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352865920 00000100:00100000:1.0:1787096568.325809:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352865920 00000100:00100000:1.0:1787096568.325865:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 275 00000100:00100000:1.0:1787096568.325875:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+19:37939:x1873906352865920:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1787096568.325895:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096568.325912:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b4470c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6e9a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.325968:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44713 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.325981:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44713 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.325993:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44713 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326028:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4471a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326037:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4471a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326044:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4471a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326081:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44713 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326089:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44713 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326108:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44713 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326115:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44713 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326121:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9ce000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096568.326126:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44713 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326134:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44713 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326146:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:1.0:1787096568.326148:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096568.326153:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44713 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326159:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b44713 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326170:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4471a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326176:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4471a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326181:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4471a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326186:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cf800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096568.326194:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4471a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326201:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4471a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326209:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67f1858 (ffff9c9d6b3f4200) 00010000:00010000:1.0:1787096568.326211:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096568.326214:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4471a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326220:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b4471a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326245:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b4470c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e9a expref: 20 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326255:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:1.0:1787096568.326257:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096568.326261:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf400/0x1b9fb40e15b4470c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e9a expref: 20 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.326269:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9cf400, rc 0) 00000100:00100000:1.0:1787096568.326320:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+19:37939:x1873906352865920:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 448us (823us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096568.326327:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 275 00000100:00100000:1.0:1787096568.329620:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096568.329757:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352866176 00000100:00100000:2.0:1787096568.329767:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352866176 00000100:00100000:2.0:1787096568.329839:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 276 00000100:00100000:2.0:1787096568.329851:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+19:37939:x1873906352866176:12345-192.168.203.27@tcp:36:lfs.0 00010000:00010000:2.0:1787096568.329914:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787096568.329938:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceac00/0x1b9fb40e15b44705 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6e93 expref: 19 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.329955:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:2.0:1787096568.329960:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096568.330008:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44721 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.330021:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44721 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.330031:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44721 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.330046:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b44728 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x67f1858 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.330053:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b44728 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.330060:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b44728 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787096568.331556:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000400:0x3:0x0].7, 2152 off44184 00000040:00080000:2.0:1787096568.331633:0:6480:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x240000401:0x3:0x0].7, 2352 off45224 00000004:00080000:2.0:1787096568.331642:0:6480:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9c9d58ab9780 with version 13 00000004:00080000:0.0:1787096568.332185:0:7720:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d4551c600 version 13 rpc_version 13 00000020:00100000:0.0:1787096568.332216:0:7720:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1787096568.332222:0:7720:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d57c25c00 x1873906360276736/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 4216/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787096568.332241:0:7720:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d57c25c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360276736:0@lo:1000:osp_up1-0.0 00000100:00100000:0.0:1787096568.332289:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096568.332322:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360276736 00000100:00100000:0.0:1787096568.332326:0:7720:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42ce3180 going to sleep for 11 seconds 00000100:00100000:1.0:1787096568.332327:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360276736 00000100:00100000:1.0:1787096568.332377:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787096568.332409:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d507cb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7720:x1873906360276736:12345-0@lo:1000:osp_up1-0.0 00000100:00100000:1.0:1787096568.332820:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d507cb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7720:x1873906360276736:12345-0@lo:1000:osp_up1-0.0 Request processed in 427us (528us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1787096568.332829:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787096568.333033:0:7720:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d57c25c00 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360276736:0@lo:1000:osp_up1-0.0 00010000:00010000:2.0:1787096568.333127:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b4472f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.333141:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b4472f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.333157:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b4472f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.333176:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b44736 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.333184:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b44736 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.333191:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b44736 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.333213:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4a800/0x1b9fb40e15b4473d lrc: 3/0,1 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.333218:0:6480:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4a800/0x1b9fb40e15b4473d lrc: 3/0,1 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.333227:0:6480:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4a800/0x1b9fb40e15b4473d lrc: 3/0,1 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096568.333237:0:6480:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6480:1873906360276864:0@lo:101:mdt00_001.0 00000100:00100000:2.0:1787096568.333260:0:6480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096568.333277:0:6480:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c41e4b900 going to sleep for 11 seconds 00000100:00100000:0.0:1787096568.333299:0:6485:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360276864 00000100:00100000:0.0:1787096568.333304:0:6485:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360276864 00000100:00100000:0.0:1787096568.333344:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787096568.333351:0:6485:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6480:x1873906360276864:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1787096568.333362:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787096568.333377:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b44744 lrc: 2/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1b9fb40e15b4473d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096568.333421:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b44744 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1b9fb40e15b4473d expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096568.333434:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b44744 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b4473d expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096568.333443:0:6485:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff9c9d6b35c700) 00010000:00010000:0.0:1787096568.333446:0:6485:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787096568.333449:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ccea400, rc 0) 00000100:00100000:0.0:1787096568.333486:0:6485:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6480:x1873906360276864:12345-0@lo:101:mdt00_001.0 Request processed in 136us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787096568.333503:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787096568.333522:0:6480:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6480:1873906360276864:0@lo:101:mdt00_001.0 00010000:00010000:1.0:1787096568.333541:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4a800/0x1b9fb40e15b4473d lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44744 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.333552:0:6480:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4a800/0x1b9fb40e15b4473d lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1b9fb40e15b44744 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096568.333569:0:6480:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bc6219bb reply state 000000003c5a9090 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b44736 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.333593:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b44736 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.333599:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff9c9d6b340600) 00010000:00010000:1.0:1787096568.333602:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096568.333605:0:6480:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787096568.333611:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4a800/0x1b9fb40e15b4473d lrc: 4/0,1 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44744 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.333619:0:6480:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4a800/0x1b9fb40e15b4473d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1b9fb40e15b44744 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787096568.333628:0:6480:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x240000401:0x7:0x0] 00000004:00010000:1.0:1787096568.333634:0:6480:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bc6219bb reply state 000000003c5a9090 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b4472f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.333655:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b4472f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.333662:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9c9d6b340700) 00010000:00010000:1.0:1787096568.333664:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096568.333667:0:6480:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000004:00200000:1.0:1787096568.333673:0:6480:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 4096 00010000:00010000:1.0:1787096568.333682:0:6480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44721 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.333690:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44721 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.333696:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44721 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.333704:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44721 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.333711:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4aa00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096568.333715:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44721 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.333723:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44721 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.333734:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:1.0:1787096568.333749:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096568.333753:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44721 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.333769:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4aa00/0x1b9fb40e15b44721 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787096568.333781:0:6480:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000bc6219bb reply state 000000003c5a9090 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b44728 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.333789:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b44728 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.333796:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67f1858 (ffff9c9d6b340100) 00010000:00010000:1.0:1787096568.333798:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1787096568.333800:0:6480:0:(service.c:179:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1787096568.333863:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+20:37939:x1873906352866176:12345-192.168.203.27@tcp:36:lfs.0 Request processed in 4014us (4249us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787096568.333870:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 276 00000100:00100000:0.0:1787096568.349661:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096568.349729:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352866304 00000100:00100000:3.0:1787096568.349749:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352866304 00000100:00100000:3.0:1787096568.349803:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 277 00000100:00100000:3.0:1787096568.349811:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+20:37942:x1873906352866304:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096568.349834:0:7414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096568.349851:0:7414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b4474b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6ea1 expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.349910:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44752 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.349951:0:7414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.349965:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096568.350013:0:7414:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1787096568.350017:0:7414:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1787096568.350034:0:7414:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44752 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.350054:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3600/0x1b9fb40e15b4474b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ea1 expref: 22 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.350068:0:7414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2800/0x1b9fb40e15b44752 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ea1 expref: 21 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.350076:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:3.0:1787096568.350080:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787096568.350094:0:7414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2800, rc 0) 00000100:00100000:3.0:1787096568.350145:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+21:37942:x1873906352866304:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 335us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096568.350151:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 277 00000100:00100000:2.0:1787096568.353274:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096568.353336:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352866432 00000100:00100000:3.0:1787096568.353351:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352866432 00000100:00100000:3.0:1787096568.353438:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 278 00000100:00100000:3.0:1787096568.353452:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+21:37942:x1873906352866432:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096568.353475:0:18819:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096568.353514:0:18819:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44759 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6ea8 expref: -99 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353602:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44760 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353618:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353631:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44760 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353643:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44767 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353656:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353663:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353773:0:18819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4476e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353782:0:18819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4476e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353789:0:18819:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4476e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787096568.353880:0:18819:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x17:0x0]: returning size 4096 00000004:00200000:3.0:1787096568.353885:0:18819:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00010000:3.0:1787096568.353906:0:18819:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4476e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353923:0:18819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44760 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353932:0:18819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44760 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353937:0:18819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44760 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353941:0:18819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44760 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353945:0:18819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3c00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096568.353948:0:18819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44760 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353953:0:18819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44760 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353962:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c9c41286000) 00010000:00010000:3.0:1787096568.353964:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096568.353969:0:18819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44760 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353972:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3c00/0x1b9fb40e15b44760 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353982:0:18819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44767 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353986:0:18819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44767 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353994:0:18819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44767 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.353997:0:18819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096568.353998:0:18819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44767 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.354009:0:18819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44767 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.354017:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67f1858 (ffff9c9d6b340100) 00010000:00010000:3.0:1787096568.354019:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787096568.354022:0:18819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44767 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.354027:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b44767 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.354059:0:18819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b44759 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ea8 expref: 23 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.354071:0:18819:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3800/0x1b9fb40e15b4476e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x17:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ea8 expref: 22 pid: 18819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.354077:0:18819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9c9d6b340700) 00010000:00010000:3.0:1787096568.354078:0:18819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787096568.354080:0:18819:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac3800, rc 0) 00000100:00100000:3.0:1787096568.354148:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+22:37942:x1873906352866432:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 700us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096568.354165:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 278 00000100:00100000:1.0:1787096568.356383:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:0.0:1787096568.356855:0:6479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352866560 00000100:00100000:0.0:1787096568.356870:0:6479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352866560 00000100:00100000:1.0:1787096568.357003:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 279 00000100:00100000:1.0:1787096568.357016:0:6479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+22:37942:x1873906352866560:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1787096568.357037:0:6479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096568.357055:0:6479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b44775 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6eaf expref: -99 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.357196:0:6479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b4477c lrc: 3/1,0 mode: --/PR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.357212:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b4477c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.357223:0:6479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b4477c lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787096568.357280:0:6479:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000400:0x7:0x0]: returning size 4096 00000004:00200000:1.0:1787096568.357285:0:6479:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00010000:00010000:1.0:1787096568.357316:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b44775 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6eaf expref: 24 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.357332:0:6479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b4477c lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6eaf expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.357340:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff9c9d6b340600) 00010000:00010000:1.0:1787096568.357343:0:6479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787096568.357347:0:6479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9ce000, rc 0) 00000100:00100000:1.0:1787096568.357438:0:6479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:47c5a664-3f41-4887-ab67-ea7db94c9f90+23:37942:x1873906352866560:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 424us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096568.357446:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 279 00000100:00100000:0.0:1787096568.359303:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096568.359385:0:9995:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352866688 00000100:00100000:1.0:1787096568.359418:0:9995:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352866688 00000100:00100000:1.0:1787096568.359461:0:9995:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 280 00000100:00100000:1.0:1787096568.359469:0:9995:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+10:37942:x1873906352866688:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1787096568.359489:0:9995:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096568.359504:0:9995:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf200/0x1b9fb40e15b44783 lrc: 2/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6eb6 expref: -99 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.359546:0:9995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b4478a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.359559:0:9995:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b44744 lrc: 2/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1b9fb40e15b4473d expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.359582:0:9995:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b4478a lrc: 4/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.359611:0:9995:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b44744 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x1b9fb40e15b4473d expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096568.359627:0:9995:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42fa4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9995:1873906360276992:0@lo:104: 00000100:00100000:1.0:1787096568.359665:0:9995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096568.359716:0:9995:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c41ae89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096568.359721:0:6464:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360276992 00000100:00100000:2.0:1787096568.359727:0:6464:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360276992 00000100:00100000:2.0:1787096568.359773:0:6464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787096568.359781:0:6464:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:9995:x1873906360276992:12345-0@lo:104: 00010000:00010000:2.0:1787096568.359793:0:6464:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4a800/0x1b9fb40e15b4473d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b9fb40e15b44744 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.359861:0:6464:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787096568.359868:0:6464:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-mdtlov_UUID+4:9995:x1873906360276992:12345-0@lo:104: Request processed in 88us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096568.359874:0:6464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:0.0:1787096568.359976:0:6469:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787096568.359983:0:6469:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4a800/0x1b9fb40e15b4473d lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x1b9fb40e15b44744 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096568.359992:0:6469:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4a800 already unused, calling callback (ffffffffc1953ee0) 00010000:00010000:0.0:1787096568.359997:0:6469:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4a800/0x1b9fb40e15b4473d lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x1b9fb40e15b44744 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787096568.360005:0:6469:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4a800/0x1b9fb40e15b4473d lrc: 4/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x1b9fb40e15b44744 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096568.360030:0:6469:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4a800/0x1b9fb40e15b4473d lrc: 2/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b44744 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096568.360037:0:6469:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787096568.360060:0:6469:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4a800/0x1b9fb40e15b4473d lrc: 1/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b44744 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096568.360068:0:6469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0001-osp-MDT0000 lock: ffff9c9d7ca4a800/0x1b9fb40e15b4473d lrc: 0/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x12 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x1b9fb40e15b44744 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787096568.360091:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096568.360095:0:3625:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d57c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1873906360277120:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096568.360096:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787096568.360099:0:6469:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787096568.360128:0:3625:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096568.360174:0:9995:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42fa4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001_UUID:9995:1873906360276992:0@lo:104: 00010000:00010000:1.0:1787096568.360193:0:9995:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b4478a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096568.360236:0:9435:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360277120 00000100:00100000:0.0:1787096568.360240:0:9435:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360277120 00010000:00010000:0.0:1787096568.360258:0:9435:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b44744 lrc: 3/0,0 mode: PW/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x1b9fb40e15b4473d expref: 8 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096568.360285:0:9435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787096568.360294:0:9435:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+8:3625:x1873906360277120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787096568.360303:0:9435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000001:00080000:2.0:1787096568.364176:0:7392:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967349 is committed 00000001:00080000:2.0:1787096568.364200:0:7392:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967347 is committed 00000020:00080000:2.0:1787096568.364209:0:7392:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 7 batchid updated 00010000:00010000:1.0:1787096568.364242:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b4463a lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096568.364247:0:7417:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 7 00010000:00010000:1.0:1787096568.364258:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b4463a lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.364266:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b4463a lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.364273:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4b800 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096568.364278:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b4463a lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.364286:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b4463a lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787096568.364305:0:7417:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9c9c42ce3f00 with version 18 00000020:00080000:0.0:1787096568.364323:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 7 cancel update log [0x200000401:0x3:0x0].7: rc = 0 00010000:00010000:1.0:1787096568.364325:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x727485fe (ffff9c9d6b340b00) 00010000:00010000:1.0:1787096568.364330:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096568.364335:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b4463a lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.364343:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ca4b800/0x1b9fb40e15b4463a lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.364372:0:3611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b446bf lrc: 3/0,1 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.364379:0:3611:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b446bf lrc: 2/0,0 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.364385:0:3611:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b446bf lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.364422:0:3611:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3000 already unused, calling callback (ffffffffc19474f0) 00000020:00080000:0.0:1787096568.364424:0:7417:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 7 cancel update log [0x240000400:0x3:0x0].7: rc = 0 00010000:00010000:1.0:1787096568.364427:0:3611:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b446bf lrc: 3/0,0 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096568.364434:0:7417:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 7 00010000:00010000:1.0:1787096568.364436:0:3611:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b446bf lrc: 4/0,0 mode: TXN/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.364446:0:3611:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x6:0x0].0x727485fe (ffff9c9d6b340b00) 00010000:00010000:1.0:1787096568.364449:0:3611:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096568.364453:0:3611:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b446bf lrc: 2/0,0 mode: --/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.364459:0:3611:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6eac3000/0x1b9fb40e15b446bf lrc: 0/0,0 mode: --/TXN res: [0x240000401:0x6:0x0].0x727485fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18819 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.364478:0:9435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d7ccea400/0x1b9fb40e15b44744 lrc: 0/0,0 mode: --/PW res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x1b9fb40e15b4473d expref: 6 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.364490:0:9435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff9c9d6b35c700) 00010000:00010000:3.0:1787096568.364493:0:9435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b4478a lrc: 3/1,0 mode: --/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.364500:0:9435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b4478a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.364507:0:9435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b4478a lrc: 4/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.364540:0:9435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787096568.364602:0:9995:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b4478a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.364611:0:9995:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b4478a lrc: 3/1,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9995 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096568.364615:0:9435:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0000-mdtlov_UUID+5:3625:x1873906360277120:12345-0@lo:103:ldlm_bl.0 Request processed in 4321us (4483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096568.364628:0:9435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000004:00200000:1.0:1787096568.364662:0:9995:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240000401:0x7:0x0]: returning size 4096 00000004:00200000:1.0:1787096568.364667:0:9995:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 2 MDT count 2 00000004:00080000:2.0:1787096568.364692:0:7407:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d589526c0 version 18 rpc_version 18 00000100:00100000:0.0:1787096568.364693:0:3625:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d57c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3625:1873906360277120:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787096568.364707:0:9995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9cf200/0x1b9fb40e15b44783 lrc: 0/0,0 mode: --/CR res: [0x240000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6eb6 expref: 7 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00100000:2.0:1787096568.364720:0:7407:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1787096568.364726:0:9995:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9c9d6e9ce200/0x1b9fb40e15b4478a lrc: 3/0,0 mode: PR/PR res: [0x240000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6eb6 expref: 6 pid: 9995 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096568.364729:0:7407:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9c42d71f80 x1873906360277376/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1787096568.364755:0:9995:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240000401:0x7:0x0].0x0 (ffff9c9d6b35c700) 00010000:00010000:1.0:1787096568.364758:0:9995:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787096568.364762:0:9995:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9ce200, rc 0) 00000100:00100000:2.0:1787096568.364769:0:7407:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d71f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360277376:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096568.364809:0:7407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787096568.364817:0:9995:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:37942:x1873906352866688:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 5347us (5517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096568.364826:0:9995:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 280 00000100:00100000:2.0:1787096568.364837:0:7407:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c41e4b840 going to sleep for 11 seconds 00000100:00100000:3.0:1787096568.365316:0:6484:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360277376 00000100:00100000:3.0:1787096568.365323:0:6484:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360277376 00000100:00100000:3.0:1787096568.365360:0:6484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1787096568.365368:0:6484:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+8:7407:x1873906360277376:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1787096568.365502:0:6484:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+9:7407:x1873906360277376:12345-0@lo:1000:osp_up0-1.0 Request processed in 134us (691us total) trans 4294967397 rc 0/0 00000100:00100000:3.0:1787096568.365510:0:6484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1787096568.365527:0:7407:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d71f80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7407:1873906360277376:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1787096568.367360:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096568.367806:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352866816 00000100:00100000:1.0:1787096568.367814:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352866816 00000100:00100000:1.0:1787096568.367909:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 281 00000100:00100000:1.0:1787096568.367920:0:6481:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+23:37942:x1873906352866816:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:1.0:1787096568.367936:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787096568.367951:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b44791 lrc: 2/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6ebd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368033:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44798 lrc: 3/1,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368047:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44798 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368057:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44798 lrc: 3/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368072:0:6481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b4479f lrc: 3/1,0 mode: --/PR res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368078:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b4479f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368085:0:6481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b4479f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368133:0:6481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44798 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368140:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44798 lrc: 4/1,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368146:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44798 lrc: 3/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368152:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44798 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368157:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cea00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096568.368166:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44798 lrc: 4/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368174:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44798 lrc: 5/0,0 mode: CR/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368185:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff9c9d6b340600) 00010000:00010000:1.0:1787096568.368188:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096568.368192:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44798 lrc: 3/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368198:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cea00/0x1b9fb40e15b44798 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368209:0:6481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b4479f lrc: 3/1,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368215:0:6481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b4479f lrc: 2/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368221:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b4479f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368226:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6e9cec00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096568.368228:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b4479f lrc: 3/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368234:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b4479f lrc: 4/0,0 mode: PR/PR res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368241:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x91dd68a8 (ffff9c9d6b3f4200) 00010000:00010000:1.0:1787096568.368243:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096568.368253:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b4479f lrc: 2/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368259:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cec00/0x1b9fb40e15b4479f lrc: 0/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368287:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b44791 lrc: 1/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ebd expref: 24 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368297:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff9c9d6b340600) 00010000:00010000:1.0:1787096568.368300:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096568.368303:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9cf800/0x1b9fb40e15b44791 lrc: 0/0,0 mode: --/CR res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ebd expref: 24 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.368312:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6e9cf800, rc 0) 00000100:00100000:1.0:1787096568.368363:0:6481:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+23:37942:x1873906352866816:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 446us (1006us total) trans 0 rc 301/301 00000100:00100000:1.0:1787096568.368370:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 281 00000100:00100000:0.0:1787096568.371458:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096568.371496:0:6480:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352867072 00000100:00100000:2.0:1787096568.371510:0:6480:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352867072 00000100:00100000:2.0:1787096568.371563:0:6480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 282 00000100:00100000:2.0:1787096568.371572:0:6480:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+23:37942:x1873906352867072:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:2.0:1787096568.371589:0:6480:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787096568.371592:0:6480:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787096568.371610:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6e9ce000/0x1b9fb40e15b4477c lrc: 0/0,0 mode: --/PR res: [0x200000400:0x7:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6eaf expref: 23 pid: 6479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.371632:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff9c9d6b340600) 00010000:00010000:2.0:1787096568.371635:0:6480:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787096568.371643:0:6480:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b447a6 lrc: 2/0,0 mode: --/CW res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6ec4 expref: -99 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.371710:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b447ad lrc: 3/0,1 mode: --/CW res: [0x200000400:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.371719:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b447ad lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.371725:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b447ad lrc: 3/0,1 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.371735:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b447b4 lrc: 3/0,1 mode: --/PW res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.371755:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b447b4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.371762:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b447b4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.372061:0:6480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b447bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.372070:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b447bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.372078:0:6480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b447bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787096568.372107:0:6480:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 0 00010000:00010000:2.0:1787096568.372131:0:6480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b447ad lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.372138:0:6480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b447ad lrc: 4/0,1 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.372144:0:6480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b447ad lrc: 3/0,0 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.372150:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b447ad lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.372156:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4ac00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:2.0:1787096568.372159:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b447ad lrc: 4/0,0 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.372166:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b447ad lrc: 5/0,0 mode: CW/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.372174:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff9c9d6b340600) 00010000:00010000:2.0:1787096568.372177:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787096568.372180:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b447ad lrc: 3/0,0 mode: --/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.372187:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ac00/0x1b9fb40e15b447ad lrc: 0/0,0 mode: --/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787096568.372196:0:6480:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000720dfc9d reply state 00000000173c2022 transno 4294967398 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b447b4 lrc: 3/0,1 mode: PW/PW res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.372216:0:6480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b447b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.372223:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x91dd68a8 (ffff9c9c42964600) 00010000:00010000:2.0:1787096568.372225:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1787096568.372227:0:6480:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787096568.372249:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a200/0x1b9fb40e15b447a6 lrc: 0/0,0 mode: --/CW res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ec4 expref: 25 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.372261:0:6480:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b447bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ec4 expref: 24 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787096568.372268:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9c9c42964100) 00010000:00010000:2.0:1787096568.372271:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787096568.372273:0:6480:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d7ca4ae00, rc 0) 00000100:00100000:2.0:1787096568.372322:0:6480:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:47c5a664-3f41-4887-ab67-ea7db94c9f90+25:37942:x1873906352867072:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 751us (872us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787096568.372331:0:6480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 282 00000100:00100000:0.0:1787096568.374158:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096568.374217:0:7414:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352867328 00000100:00100000:3.0:1787096568.374224:0:7414:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352867328 00000100:00100000:3.0:1787096568.374264:0:7414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 283 00000100:00100000:3.0:1787096568.374276:0:7414:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+25:37942:x1873906352867328:12345-192.168.203.27@tcp:101:lfs.0 00010000:00010000:3.0:1787096568.374301:0:7414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787096568.374313:0:7414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b447c9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8ce29da6e2cc6ecb expref: -99 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.374379:0:7414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b447d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.374424:0:7414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b447bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ec4 expref: 26 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.374434:0:7414:0:(ldlm_resource.c:1724:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b447d0 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.374468:0:7414:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b447bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ec4 expref: 26 pid: 6480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.374480:0:7414:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b447bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ec4 expref: 26 pid: 6480 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787096568.374494:0:7414:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42e08380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7414:1873906360277504:192.168.203.27@tcp:104: 00000100:00100000:3.0:1787096568.374569:0:7414:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9d42e9d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787096568.376199:0:7414:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42e08380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7414:1873906360277504:192.168.203.27@tcp:104: 00010000:00010000:3.0:1787096568.376214:0:7414:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b447d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096568.376848:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096568.376920:0:7855:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352867456 00000100:00100000:1.0:1787096568.376926:0:7855:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352867456 00010000:00010000:1.0:1787096568.376953:0:7855:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b447bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ec4 expref: 27 pid: 6480 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096568.377015:0:7855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 93 00000100:00100000:1.0:1787096568.377024:0:7855:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+27:2401:x1873906352867456:12345-192.168.203.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787096568.377034:0:7855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787096568.377041:0:7855:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b447bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ec4 expref: 27 pid: 6480 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.377073:0:7855:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b447bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ec4 expref: 27 pid: 6480 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.377092:0:7855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ae00/0x1b9fb40e15b447bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ec4 expref: 27 pid: 6480 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.377108:0:7855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9c9c42964100) 00010000:00010000:1.0:1787096568.377113:0:7855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b447d0 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.377118:0:7855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b447d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.377124:0:7855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b447d0 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096568.377143:0:7855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787096568.377168:0:7414:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b447d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.377175:0:7414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b447d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787096568.377185:0:7855:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+26:2401:x1873906352867456:12345-192.168.203.27@tcp:103:ldlm_bl.0 Request processed in 160us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787096568.377193:0:7855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 93 00000004:00200000:3.0:1787096568.377200:0:7414:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000402:0x18:0x0]: returning size 0 00010000:00010000:3.0:1787096568.377298:0:7414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b447d0 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.377304:0:7414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b447d0 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.377308:0:7414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b447d0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.377312:0:7414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac2000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:3.0:1787096568.377314:0:7414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b447d0 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.377319:0:7414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b447d0 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.377324:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9c9c42964100) 00010000:00010000:3.0:1787096568.377361:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787096568.377365:0:7414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b447d0 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.377370:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2000/0x1b9fb40e15b447d0 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.377426:0:7414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b447c9 lrc: 1/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ecb expref: 25 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.377436:0:7414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x18:0x0].0x0 (ffff9c9c42964100) 00010000:00010000:3.0:1787096568.377439:0:7414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787096568.377449:0:7414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac2600/0x1b9fb40e15b447c9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x18:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.27@tcp remote: 0x8ce29da6e2cc6ecb expref: 25 pid: 7414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787096568.377464:0:7414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c9d6eac2600, rc 0) 00000100:00100000:3.0:1787096568.377497:0:7414:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:47c5a664-3f41-4887-ab67-ea7db94c9f90+24:37942:x1873906352867328:12345-192.168.203.27@tcp:101:lfs.0 Request processed in 3225us (3342us total) trans 0 rc 301/301 00000100:00100000:3.0:1787096568.377504:0:7414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 283 00000100:00100000:0.0:1787096568.379122:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:2.0:1787096568.379159:0:13479:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352867712 00000100:00100000:2.0:1787096568.379166:0:13479:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352867712 00000100:00100000:2.0:1787096568.379202:0:13479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 56 00000100:00100000:2.0:1787096568.379211:0:13479:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+24:37942:x1873906352867712:12345-192.168.203.27@tcp:35:lfs.0 00000100:00100000:2.0:1787096568.379388:0:13479:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:47c5a664-3f41-4887-ab67-ea7db94c9f90+25:37942:x1873906352867712:12345-192.168.203.27@tcp:35:lfs.0 Request processed in 178us (267us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1787096568.379499:0:13479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 56 00010000:00010000:2.0:1787096568.526670:0:7403:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787096568.526987:0:3626:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360277632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787096568.527062:0:3626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096568.527118:0:8362:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360277632 00000100:00100000:2.0:1787096568.527128:0:8362:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360277632 00000100:00100000:2.0:1787096568.527193:0:8362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787096568.527207:0:8362:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360277632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787096568.527238:0:8362:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1787096568.527298:0:8362:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c25880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1873906360277632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096568.527307:0:8362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787096568.527347:0:3626:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3626:1873906360277632:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787096568.527557:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787096568.527589:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787096568.527600:0:3628:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9c42fa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360277760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1787096568.527621:0:3628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787096568.527667:0:19615:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360277760 00000100:00100000:2.0:1787096568.527671:0:19615:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360277760 00000100:00100000:2.0:1787096568.527704:0:19615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787096568.527709:0:19615:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360277760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1787096568.527718:0:19615:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1787096568.527735:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787096568.527762:0:19615:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1873906360277760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096568.527769:0:19615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787096568.527793:0:3628:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9c42fa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3628:1873906360277760:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1787096568.953843:0:23541:0:(debug.c:651:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-ec test_26b: @@@@@@ FAIL: setstripe failed 00000001:00080000:0.0:1787096569.041350:0:6459:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000001:00080000:0.0:1787096569.041385:0:6459:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00010000:00010000:1.0:1787096569.041423:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b444a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041440:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b444a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096569.041453:0:6459:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00010000:00010000:1.0:1787096569.041467:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b444a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096569.041473:0:6459:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c9c41ae83c0 refcount 2 committed 0 result 0 batchid 5 00010000:00010000:1.0:1787096569.041476:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3200 already unused, calling callback (ffffffffc19474f0) 00000020:00080000:0.0:1787096569.041479:0:6459:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d480b4000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c41ae8a80 00010000:00010000:1.0:1787096569.041484:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b444a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096569.041484:0:6459:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].5 00000020:00080000:0.0:1787096569.041489:0:6459:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d480b4700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c42eaee00 00000020:00080000:0.0:1787096569.041498:0:6459:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].5 00010000:00010000:1.0:1787096569.041510:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b444a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041531:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x98f97dfb (ffff9c9d6b3f0000) 00010000:00010000:1.0:1787096569.041534:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096569.041539:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b444a4 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041545:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3200/0x1b9fb40e15b444a4 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041569:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44529 lrc: 3/0,1 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041576:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44529 lrc: 2/0,0 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041582:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44529 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041587:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d6eac3e00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096569.041591:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44529 lrc: 3/0,0 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096569.041601:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00010000:00010000:1.0:1787096569.041613:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44529 lrc: 4/0,0 mode: TXN/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041623:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x98f97dfb (ffff9c9d6b3f0000) 00010000:00010000:1.0:1787096569.041626:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096569.041629:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44529 lrc: 2/0,0 mode: --/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041636:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d6eac3e00/0x1b9fb40e15b44529 lrc: 0/0,0 mode: --/TXN res: [0x200000401:0x7:0x0].0x98f97dfb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6481 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041658:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b445ae lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041665:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b445ae lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041671:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b445ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041676:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4a400 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096569.041680:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b445ae lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041686:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b445ae lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041694:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xebbc3de1 (ffff9c9c41ec9c00) 00010000:00010000:1.0:1787096569.041697:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096569.041700:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b445ae lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041713:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4a400/0x1b9fb40e15b445ae lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041724:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b445b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041745:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b445b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041753:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b445b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041759:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4b200 already unused, calling callback (ffffffffc19474f0) 00000004:00080000:2.0:1787096569.041761:0:6511:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth ffff9c9c42bb5900 with version 14 00010000:00010000:1.0:1787096569.041764:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b445b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041774:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b445b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096569.041781:0:6511:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osp-MDT0000: batchid 4 cancel update log [0x240000401:0x3:0x0].4: rc = 0 00010000:00010000:1.0:1787096569.041784:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x16:0x0].0x0 (ffff9c9c41ec9d00) 00010000:00010000:1.0:1787096569.041789:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096569.041792:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b445b5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041799:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b200/0x1b9fb40e15b445b5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787096569.041813:0:7720:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff9c9d4551c600 version 14 rpc_version 14 00010000:00010000:1.0:1787096569.041820:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b445bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041828:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b445bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096569.041829:0:6511:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4 cancel update log [0x200000400:0x3:0x0].4: rc = 0 00010000:00010000:1.0:1787096569.041844:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b445bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041850:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4be00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096569.041854:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b445bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787096569.041855:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00100000:0.0:1787096569.041860:0:7720:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00010000:00010000:1.0:1787096569.041872:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b445bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041883:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x6:0x0].0x0 (ffff9c9c41ec9500) 00010000:00010000:1.0:1787096569.041887:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096569.041890:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b445bc lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096569.041893:0:7720:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9c9d57c27800 x1873906360278016/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:1.0:1787096569.041898:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4be00/0x1b9fb40e15b445bc lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9995 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041913:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b446db lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041939:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b446db lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041952:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b446db lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.041957:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7cceb400 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096569.041969:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b446db lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096569.041973:0:7720:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff9c9d57c27800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360278016:0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1787096569.042002:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b446db lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042012:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xebbc3de1 (ffff9c9c41ec9c00) 00010000:00010000:1.0:1787096569.042014:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096569.042018:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b446db lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042024:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7cceb400/0x1b9fb40e15b446db lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xebbc3de1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042041:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b44728 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042048:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b44728 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042054:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b44728 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042061:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4ba00 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096569.042065:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b44728 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042074:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b44728 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096569.042076:0:7720:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787096569.042144:0:7720:0:(client.c:2692:ptlrpc_set_wait()) set ffff9c9c42ce33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787096569.042207:0:7409:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906360278016 00000100:00100000:2.0:1787096569.042216:0:7409:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906360278016 00000100:00100000:2.0:1787096569.042275:0:7409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787096569.042284:0:7409:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d57c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7720:x1873906360278016:12345-0@lo:1000:osp_up1-0.0 00010000:00010000:1.0:1787096569.042378:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x67f1858 (ffff9c9d6b340100) 00010000:00010000:1.0:1787096569.042382:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096569.042387:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b44728 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042426:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4ba00/0x1b9fb40e15b44728 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x67f1858 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042444:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b4472f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042452:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b4472f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042459:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b4472f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042465:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4b600 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096569.042469:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b4472f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042475:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b4472f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787096569.042485:0:7409:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d57c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7720:x1873906360278016:12345-0@lo:1000:osp_up1-0.0 Request processed in 198us (409us total) trans 4294967350 rc 0/0 00010000:00010000:1.0:1787096569.042490:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x17:0x0].0x0 (ffff9c9d6b340700) 00010000:00010000:1.0:1787096569.042494:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096569.042497:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b4472f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787096569.042507:0:7720:0:(client.c:3102:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967349 gen 2 00000004:00080000:0.0:1787096569.042516:0:7720:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967348 committed transno 4294967349 00010000:00010000:1.0:1787096569.042517:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b600/0x1b9fb40e15b4472f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096569.042523:0:7720:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c9c42e45a80 refcount 2 committed 0 result 0 batchid 6 00000100:00100000:2.0:1787096569.042529:0:7409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000020:00080000:0.0:1787096569.042536:0:7720:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d480b4d00 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c42e45c00 00000020:00080000:0.0:1787096569.042543:0:7720:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].6 00000020:00080000:0.0:1787096569.042546:0:7720:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d480b4100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9d6e931400 00010000:00010000:1.0:1787096569.042549:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b44736 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1787096569.042550:0:7720:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].6 00010000:00010000:1.0:1787096569.042565:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b44736 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042580:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b44736 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042587:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4b000 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096569.042591:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b44736 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042598:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b44736 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787096569.042600:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 6 committed batchid 4 00010000:00010000:1.0:1787096569.042609:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x0 (ffff9c9d6b340600) 00010000:00010000:1.0:1787096569.042613:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096569.042616:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b44736 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042622:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b000/0x1b9fb40e15b44736 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787096569.042631:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1787096569.042644:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b447b4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042651:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b447b4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042656:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b447b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042661:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c9d7ca4b400 already unused, calling callback (ffffffffc19474f0) 00010000:00010000:1.0:1787096569.042664:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b447b4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042681:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b447b4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042690:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000400:0x7:0x0].0x91dd68a8 (ffff9c9c42964600) 00010000:00010000:1.0:1787096569.042692:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787096569.042695:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b447b4 lrc: 2/0,0 mode: --/TXN res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787096569.042702:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c9d7ca4b400/0x1b9fb40e15b447b4 lrc: 0/0,0 mode: --/TXN res: [0x200000400:0x7:0x0].0x91dd68a8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6480 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787096569.042730:0:7720:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 4294967349 committed transno 4294967349 00000020:00080000:0.0:1787096569.042746:0:7720:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c9d58ab9900 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1787096569.042749:0:7720:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d749cc000 obd lustre-MDT0001-osp-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c9d58ab9780 00000020:00080000:0.0:1787096569.042751:0:7720:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x240000401:0x3:0x0].7 00000020:00080000:0.0:1787096569.042753:0:7720:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9c9d749cc800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c9c42eaf000 00000020:00080000:0.0:1787096569.042764:0:7720:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000400:0x3:0x0].7 00000100:00100000:0.0:1787096569.042792:0:7720:0:(client.c:3146:ptlrpc_free_committed()) @@@ stopping search req@ffff9c9d57c27800 x1873906360278016/t4294967350(4294967350) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 488/4320 e 0 to 0 dl 1787096585 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp_up1-0.0' uid:0 gid:0 projid:4294967295 00000020:00080000:3.0:1787096569.042811:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 4 00000100:00100000:0.0:1787096569.042814:0:7720:0:(client.c:2391:ptlrpc_check_set()) Completed RPC req@ffff9c9d57c27800 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7720:1873906360278016:0@lo:1000:osp_up1-0.0 00000020:00080000:3.0:1787096569.042845:0:6511:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787096569.475467:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096569.475511:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:3.0:1787096569.475526:0:18819:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352867968 00000100:00100000:3.0:1787096569.475544:0:18819:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352867968 00000100:00100000:1.0:1787096569.475552:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.27@tcp (source: 12345-192.168.203.27@tcp) 00000100:00100000:1.0:1787096569.475577:0:6481:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352868096 00000100:00100000:1.0:1787096569.475581:0:6481:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352868096 00000100:00100000:3.0:1787096569.475620:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 246 00000100:00100000:3.0:1787096569.475633:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:2399:x1873906352867968:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:2.0:1787096569.475650:0:6475:0:(service.c:2304:ptlrpc_server_handle_req_in()) unwrap req x1873906352867840 00000100:00100000:2.0:1787096569.475654:0:6475:0:(service.c:2369:ptlrpc_server_handle_req_in()) got req x1873906352867840 00000100:00100000:2.0:1787096569.475686:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 333 00000100:00100000:2.0:1787096569.475694:0:6475:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9d51326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2400:x1873906352867840:12345-192.168.203.27@tcp:400:kworker.0 00000100:00100000:3.0:1787096569.475739:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+7:2399:x1873906352867968:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 98us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787096569.475741:0:6475:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9d51326450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:911fcbfa-c40d-448b-aa47-1f7570bacebd+9:2400:x1873906352867840:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 36us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096569.475759:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 246 00000100:00100000:2.0:1787096569.475759:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 333 00000100:00100000:3.0:1787096569.475788:0:18819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.27@tcp, seq: 247 00000100:00100000:3.0:1787096569.475796:0:18819:0:(service.c:2555:ptlrpc_server_handle_request()) Handling RPC req@ffff9c9c42fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:2400:x1873906352868096:12345-192.168.203.27@tcp:400:kworker.0 00000100:00080000:2.0:1787096569.475815:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1787096569.475820:0:6476:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787096569.475827:0:18819:0:(service.c:2613:ptlrpc_server_handle_request()) Handled RPC req@ffff9c9c42fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:47c5a664-3f41-4887-ab67-ea7db94c9f90+6:2400:x1873906352868096:12345-192.168.203.27@tcp:400:kworker.0 Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787096569.475834:0:18819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.27@tcp, seq: 247 00010000:00010000:0.0:1787096569.551851:0:6468:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 1098 lines, 1098 kept, 0 dropped, 0 bad.